May 14 04:22:07.663901 np0000000747 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: we strongly recommend against using it for new projects.
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: If you are already using Eventlet, we recommend migrating to a different
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: framework.  For more detail see
May 14 04:22:07.974416 np0000000747 nova-compute[97971]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:22:07.974416 np0000000747 nova-compute[97971]:   import eventlet
May 14 04:22:09.404308 np0000000747 nova-compute[97971]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=97971) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 04:22:09.404750 np0000000747 nova-compute[97971]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=97971) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 04:22:09.404750 np0000000747 nova-compute[97971]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=97971) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 14 04:22:09.404882 np0000000747 nova-compute[97971]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 14 04:22:09.542467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:22:09.555935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.013s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:22:09.609954 np0000000747 nova-compute[97971]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 14 04:22:10.480443 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 14 04:22:10.480812 np0000000747 nova-compute[97971]: INFO nova.utils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] The long task thread pool MainProcess.long_task is initialized
May 14 04:22:10.480960 np0000000747 nova-compute[97971]: INFO nova.virt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 14 04:22:10.571994 np0000000747 nova-compute[97971]: INFO nova.compute.provider_config [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 14 04:22:11.074001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Acquiring lock "singleton_lock" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:22:11.074086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Acquired lock "singleton_lock" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:22:11.074272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Releasing lock "singleton_lock" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:22:11.074455 np0000000747 nova-compute[97971]: WARNING oslo_service.backend._threading.service [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] no_fork=True: running service in main process
May 14 04:22:11.074743 np0000000747 nova-compute[97971]: INFO nova.service [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Starting compute node (version 33.1.0)
May 14 04:22:11.578036 np0000000747 nova-compute[97971]: INFO nova.utils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] The default thread pool MainProcess.default is initialized
May 14 04:22:11.578452 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:22:11.578587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Starting event thread {{(pid=97971) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 14 04:22:11.579403 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Starting connection event dispatch thread {{(pid=97971) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 14 04:22:11.579969 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Connecting to libvirt: qemu:///system {{(pid=97971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 14 04:22:12.362247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x743636c26b10> {{(pid=97971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 14 04:22:12.363185 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x743636c26b10> {{(pid=97971) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 14 04:22:12.363716 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Connection event '1' reason 'None'
May 14 04:22:12.866092 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Cannot update service status on host "np0000000747" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000747 could not be found.
May 14 04:22:12.866491 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.mount [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Initialising _HostMountState generation 0 {{(pid=97971) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 14 04:22:22.603886 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host capabilities <capabilities>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:   <host>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     <uuid>858f6015-de81-42a7-a25c-7f7b0ad765b9</uuid>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     <cpu>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <arch>x86_64</arch>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <model>EPYC-Milan</model>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <microcode version='16777317'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <signature family='25' model='1' stepping='1'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <maxphysaddr mode='emulate' bits='40'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='x2apic'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='tsc-deadline'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='osxsave'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='hypervisor'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='tsc_adjust'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='ospke'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='vaes'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='vpclmulqdq'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='spec-ctrl'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='stibp'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='arch-capabilities'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='ssbd'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='cmp_legacy'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='topoext'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='stibp-always-on'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='virt-ssbd'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='amd-psfd'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='lbrv'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='tsc-scale'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='vmcb-clean'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='flushbyasid'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='pause-filter'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='pfthreshold'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='v-vmsave-vmload'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='vgif'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='no-nested-data-bp'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='lfence-always-serializing'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='null-sel-clr-base'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='rdctl-no'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='skip-l1dfl-vmentry'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='mds-no'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='pschange-mc-no'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <feature name='gds-no'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <pages unit='KiB' size='4'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <pages unit='KiB' size='2048'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <pages unit='KiB' size='1048576'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     </cpu>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     <power_management/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     <iommu support='no'/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     <migration_features>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <live/>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       <uri_transports>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:         <uri_transport>tcp</uri_transport>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:         <uri_transport>rdma</uri_transport>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:       </uri_transports>
May 14 04:22:22.603886 np0000000747 nova-compute[97971]:     </migration_features>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:     <topology>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <cells num='1'>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:         <cell id='0'>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <memory unit='KiB'>24607188</memory>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <pages unit='KiB' size='4'>6151797</pages>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <pages unit='KiB' size='2048'>0</pages>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <pages unit='KiB' size='1048576'>0</pages>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <distances>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <sibling id='0' value='10'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           </distances>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           <cpus num='12'>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:           </cpus>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:         </cell>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       </cells>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:     </topology>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:     <cache>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 14 04:22:22.605633 np0000000747 nova-compute[97971]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     </cache>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <secmodel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <model>apparmor</model>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <doi>0</doi>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     </secmodel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <secmodel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <model>dac</model>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <doi>0</doi>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     </secmodel>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:   </host>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <arch name='alpha'>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>clipper</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:     <arch name='armv6l'>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>borzoi</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>spitz</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>nuri</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-b1</machine>
May 14 04:22:22.606423 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatileab</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>kzm</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-a</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>smdkc210</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>z2</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tosa</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>sabrelite</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-eb</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n810</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n800</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 04:22:22.607497 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatilepb</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>terrier</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mainstone</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>integratorcp</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>midway</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>musicpal</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>microbit</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='3'>fby35</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cubieboard</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>verdex</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>bpim2u</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduino2</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>raspi2b</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cheetah</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 04:22:22.608854 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>highbank</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>akita</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>connex</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>collie</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi0</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:     <arch name='armv7l'>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>borzoi</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>spitz</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>nuri</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-b1</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatileab</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>kzm</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-a</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 04:22:22.609827 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>smdkc210</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>z2</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tosa</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>sabrelite</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-eb</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n810</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n800</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatilepb</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>terrier</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mainstone</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>integratorcp</machine>
May 14 04:22:22.610657 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>midway</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>musicpal</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>microbit</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='3'>fby35</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cubieboard</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>verdex</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>bpim2u</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduino2</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>raspi2b</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cheetah</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>highbank</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>akita</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>connex</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>collie</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi0</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 04:22:22.611840 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:     <arch name='aarch64'>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.2</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mori-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>ast2600-evb</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>borzoi</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>spitz</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.7</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>nuri</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>romulus-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.0</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.0</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>npcm750-evb</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.10</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>rainier-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps3-an547</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.8</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-b1</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatileab</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>kzm</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fby35-bmc</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>musca-a</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-3.1</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.1</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>smdkc210</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.11</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>imx25-pdk</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.9</machine>
May 14 04:22:22.612513 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>orangepi-pc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>z2</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-5.2</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>tosa</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an500</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.12</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps2-an521</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>sabrelite</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an511</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>canon-a1100</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-eb</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>sbsa-ref</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.0</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.0</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi1ap</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sx1-v1</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n810</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g220a-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>n800</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.1</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.1</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>quanta-gsj</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>versatilepb</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>terrier</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mainstone</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>integratorcp</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-7.2</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-4.2</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 14 04:22:22.613256 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>mps3-an524</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>kudo-bmc</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a9</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>midway</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>musicpal</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s811evb</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>microbit</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='3'>fby35</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an505</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an385</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.0</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.0</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>raspi3ap</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cubieboard</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast1030-evb</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>verdex</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>bpim2u</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduino2</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mps2-an386</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.1</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-8.1</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>raspi3b</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>raspi2b</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>vexpress-a15</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='2'>fuji-bmc</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt-6.2</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>cheetah</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>virt-2.6</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ast2500-evb</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>highbank</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>akita</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>connex</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>netduinoplus2</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>collie</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>raspi0</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <acpi default='on' toggle='yes'/>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.613942 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     <arch name='cris'>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>axis-dev88</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:     <arch name='i686'>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 14 04:22:22.614676 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>x-remote</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 14 04:22:22.615595 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>isapc</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 14 04:22:22.616376 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>microvm</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 14 04:22:22.617256 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <domain type='kvm'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <pae/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <nonpae/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <acpi default='on' toggle='yes'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <apic default='on' toggle='no'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <arch name='m68k'>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mcf5208evb</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-7.0</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>an5206</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-6.0</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>q800</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-8.1</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-7.2</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-6.2</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-8.0</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>next-cube</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-7.1</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-6.1</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virt-8.2</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <arch name='microblaze'>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:     <arch name='microblazeel'>
May 14 04:22:22.618159 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <arch name='mips'>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>malta</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mipssim</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <arch name='mipsel'>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>malta</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mipssim</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <arch name='mips64'>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>malta</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mipssim</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>pica61</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>magnum</machine>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:     <arch name='mips64el'>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 14 04:22:22.619315 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>malta</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>loongson3-virt</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mipssim</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>pica61</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>magnum</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='16'>boston</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>fuloong2e</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <arch name='ppc'>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g3beige</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>amigaone</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mac99</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ppce500</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sam460ex</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>pegasos2</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>bamboo</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>40p</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ref405ep</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:     <arch name='ppc64'>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-noble</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>amigaone</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv9</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 14 04:22:22.620436 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv10</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ppce500</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>40p</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>pegasos2</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>bamboo</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-focal</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g3beige</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-disco</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 14 04:22:22.621519 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mac99</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-impish</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-artful</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sam460ex</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ref405ep</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv8</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:     <arch name='ppc64le'>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-noble</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>amigaone</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv9</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='15'>mpc8544ds</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv10</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ppce500</machine>
May 14 04:22:22.622314 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>40p</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>pegasos2</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>bamboo</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-focal</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>g3beige</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-disco</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>virtex-ml507</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>mac99</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-impish</machine>
May 14 04:22:22.623116 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-artful</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sam460ex</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>ref405ep</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='2048'>powernv8</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <arch name='riscv32'>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='8'>spike</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>opentitan</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='5'>sifive_u</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sifive_e</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <arch name='riscv64'>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='512'>virt</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='8'>spike</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='5'>sifive_u</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>shakti_c</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sifive_e</machine>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:     <arch name='s390x'>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 14 04:22:22.623784 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 14 04:22:22.624933 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <arch name='sh4'>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>shix</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>r2d</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <arch name='sh4eb'>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>shix</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>r2d</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:     <arch name='sparc'>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>SS-5</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>SS-20</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>LX</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>SPARCClassic</machine>
May 14 04:22:22.625654 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>leon3_generic</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>SPARCbook</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>SS-4</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>SS-600MP</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>SS-10</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>Voyager</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <arch name='sparc64'>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sun4u</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>niagara</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>sun4v</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:     <arch name='x86_64'>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <wordsize>64</wordsize>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 14 04:22:22.626772 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>x-remote</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 14 04:22:22.627700 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='1'>isapc</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 14 04:22:22.628297 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>microvm</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 14 04:22:22.628908 np0000000747 nova-compute[97971]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <domain type='kvm'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <acpi default='on' toggle='yes'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <apic default='on' toggle='no'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <arch name='xtensa'>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>sim</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>kc705</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ml605</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ml605-nommu</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>virt</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx60-nommu</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx200</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx200-nommu</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx60</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>kc705-nommu</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:   <guest>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <os_type>hvm</os_type>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:     <arch name='xtensaeb'>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <wordsize>32</wordsize>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='4'>sim</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>kc705</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ml605</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>ml605-nommu</machine>
May 14 04:22:22.629884 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>virt</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx60-nommu</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx200</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx200-nommu</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>lx60</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <machine maxCpus='32'>kc705-nommu</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <domain type='qemu'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     </arch>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <features>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <cpuselection/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <deviceboot/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <disksnapshot default='on' toggle='no'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <externalSnapshot/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     </features>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   </guest>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]: </capabilities>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]: 
May 14 04:22:22.631851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.631851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 14 04:22:22.631851 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-alpha</path>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <machine>clipper</machine>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <arch>alpha</arch>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <vcpu max='4'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.631851 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.632980 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.634852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.634852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 14 04:22:22.634852 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-arm</path>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <machine>virt-8.2</machine>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <arch>armv6l</arch>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.634852 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 04:22:22.635946 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.636694 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <gic supported='yes'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       <enum name='version'>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>2</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:         <value>3</value>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     </gic>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.638886 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.640485 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 14 04:22:22.640485 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-arm</path>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <machine>virt-8.2</machine>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <arch>armv6l</arch>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 04:22:22.640485 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.641283 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.642644 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <gic supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='version'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>2</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>3</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </gic>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.644006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.644006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 14 04:22:22.644006 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-arm</path>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <machine>virt-8.2</machine>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <arch>armv7l</arch>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.644006 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 04:22:22.645530 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.646598 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     <gic supported='yes'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       <enum name='version'>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>2</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:         <value>3</value>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.647951 np0000000747 nova-compute[97971]:     </gic>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.649748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.649748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 14 04:22:22.649748 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-aarch64</path>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <machine>virt-8.2</machine>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <arch>aarch64</arch>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 14 04:22:22.649748 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 14 04:22:22.650595 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.651142 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:     <gic supported='yes'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:       <enum name='version'>
May 14 04:22:22.652124 np0000000747 nova-compute[97971]:         <value>2</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>3</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     </gic>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.653921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.653921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 14 04:22:22.653921 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-cris</path>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <machine>axis-dev88</machine>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <arch>cris</arch>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.653921 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.655578 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.657227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.657227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 14 04:22:22.657227 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-i386</path>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <machine>pc-i440fx-noble-v2</machine>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <arch>i686</arch>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <vcpu max='255'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.657227 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='lm'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 04:22:22.658168 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.659488 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.660358 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.662069 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.664189 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 14 04:22:22.664189 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-i386</path>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <machine>pc-q35-noble-v2</machine>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <arch>i686</arch>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <vcpu max='1024'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.664189 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='lm'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.665830 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.666603 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.667207 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.668437 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.671142 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 14 04:22:22.671142 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-i386</path>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <machine>pc-i440fx-noble</machine>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <arch>i686</arch>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <vcpu max='255'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.671142 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='lm'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.673310 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.674306 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.675529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.677721 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.679638 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 14 04:22:22.679638 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-i386</path>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <machine>pc-q35-noble</machine>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <arch>i686</arch>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <vcpu max='1024'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.679638 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='lm'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>qemu64</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.680976 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='unknown'>kvm64</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>core2duo</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Penryn</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.682245 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Conroe</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.682845 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.684429 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.685792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.685792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 14 04:22:22.685792 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-m68k</path>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <machine>mcf5208evb</machine>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <arch>m68k</arch>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.685792 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.686805 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.688426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 14 04:22:22.688426 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-m68k</path>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <machine>virt-8.2</machine>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <arch>m68k</arch>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.688426 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.689948 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.691878 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.691878 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 14 04:22:22.691878 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-microblaze</path>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <machine>petalogix-s3adsp1800</machine>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <arch>microblaze</arch>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.691878 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.693357 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.695001 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.695001 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 14 04:22:22.695001 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <machine>petalogix-s3adsp1800</machine>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <arch>microblazeel</arch>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.695001 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.696302 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.697916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.697916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 14 04:22:22.697916 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-mips</path>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <machine>malta</machine>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <arch>mips</arch>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <vcpu max='16'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.697916 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.699634 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.700994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.700994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 14 04:22:22.700994 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-mipsel</path>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <machine>malta</machine>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <arch>mipsel</arch>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <vcpu max='16'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.700994 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.702018 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.703498 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.703498 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 14 04:22:22.703498 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-mips64</path>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <machine>malta</machine>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <arch>mips64</arch>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <vcpu max='16'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.703498 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.704719 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.706082 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.707192 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.707192 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 14 04:22:22.707192 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-mips64el</path>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <machine>malta</machine>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <arch>mips64el</arch>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <vcpu max='16'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.707192 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.708254 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.710172 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.710172 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 14 04:22:22.710172 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc</path>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <machine>g3beige</machine>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <arch>ppc</arch>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.710172 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.711901 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.713545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.713545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 14 04:22:22.713545 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <machine>pseries-noble</machine>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <arch>ppc64</arch>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <vcpu max='4096'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.713545 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.714597 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>tpm-spapr</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>spapr-tpm-proxy</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.716466 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.718500 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 14 04:22:22.718500 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <machine>pseries-noble</machine>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <arch>ppc64</arch>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <vcpu max='4096'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.718500 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>tpm-spapr</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>spapr-tpm-proxy</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.720523 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.722735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 14 04:22:22.722735 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc64</path>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <machine>powernv9</machine>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <arch>ppc64</arch>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <vcpu max='2048'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.722735 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.724501 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>tpm-spapr</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>spapr-tpm-proxy</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.726886 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.726886 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 14 04:22:22.726886 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.726886 np0000000747 nova-compute[97971]:   <machine>powernv9</machine>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <arch>ppc64le</arch>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <vcpu max='2048'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.728811 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>tpm-spapr</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>spapr-tpm-proxy</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.730766 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.732610 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 14 04:22:22.732610 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <machine>pseries-noble</machine>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <arch>ppc64le</arch>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <vcpu max='4096'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.732610 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>tpm-spapr</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:         <value>spapr-tpm-proxy</value>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.733714 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.735053 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.735053 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 14 04:22:22.735053 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-riscv32</path>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <machine>virt</machine>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <arch>riscv32</arch>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.735053 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.736229 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.737758 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.739041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.739041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 14 04:22:22.739041 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-riscv64</path>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <machine>virt</machine>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <arch>riscv64</arch>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <vcpu max='512'/>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>any</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>max</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.739041 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.739905 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.741123 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.741123 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 14 04:22:22.741123 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-s390x</path>
May 14 04:22:22.741123 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <machine>s390-ccw-virtio-noble</machine>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <arch>s390x</arch>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <vcpu max='248'/>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.3</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.2</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.4</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z196</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z114-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen16b</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen16a</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.5</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z196.2</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zEC12</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9BC</model>
May 14 04:22:22.742119 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13.2</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14.2</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z196-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z800</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>max</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen15b</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen15a</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z114</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13s</model>
May 14 04:22:22.743096 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890.3</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890.2</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z890-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z10BC</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>zBC12</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z990-base</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.743810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <s390-pv supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.744776 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.746036 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.746036 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 14 04:22:22.746036 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-sh4</path>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <machine>shix</machine>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <arch>sh4</arch>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.746036 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.746995 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.748274 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.748274 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 14 04:22:22.748274 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <machine>shix</machine>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <arch>sh4eb</arch>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.748274 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.749226 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.750527 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.750527 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 14 04:22:22.750527 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-sparc</path>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <machine>SS-5</machine>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <arch>sparc</arch>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.750527 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <redirdev supported='no'/>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.751542 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='model'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.752946 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.752946 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 14 04:22:22.752946 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-sparc64</path>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <machine>sun4u</machine>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <arch>sparc64</arch>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <vcpu max='1'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.752946 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.754016 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.755710 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.755710 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 14 04:22:22.755710 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <machine>pc-i440fx-noble-v2</machine>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <arch>x86_64</arch>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <vcpu max='255'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.755710 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.756901 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.758110 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.758686 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.759463 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.760693 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 14 04:22:22.760693 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <machine>pc-q35-noble-v2</machine>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <arch>x86_64</arch>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <vcpu max='1024'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.760693 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.761810 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 04:22:22.762747 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.763317 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.764037 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.765248 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.765248 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 14 04:22:22.765248 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <machine>pc-i440fx-noble</machine>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <arch>x86_64</arch>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <vcpu max='255'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.766447 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.767862 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.768520 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>ide</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.769531 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.770850 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.771998 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 14 04:22:22.771998 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-x86_64</path>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <machine>pc-q35-noble</machine>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <arch>x86_64</arch>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <vcpu max='1024'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     <enum name='firmware'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <value>efi</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='yes'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <enum name='maximumMigratable'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>on</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:         <value>off</value>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='yes'>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <model fallback='forbid'>EPYC</model>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <vendor>AMD</vendor>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='acpi'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='ss'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='monitor'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='hypervisor'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='erms'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='mpx'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='pcommit'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='clwb'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='umip'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='pku'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='vaes'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='la57'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='rdpid'/>
May 14 04:22:22.771998 np0000000747 nova-compute[97971]:       <feature policy='require' name='pks'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrm'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='fzrm'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrs'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='fsrc'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnowext'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='3dnow'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='xsaveerptr'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='wbnoinvd'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='npt'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='vgif'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='require' name='svme-addr-chk'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='vme'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='xsavec'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='fxsr_opt'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='misalignsse'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='osvw'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='topoext'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <feature policy='disable' name='nrip-save'/>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:     <mode name='custom' supported='yes'>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>phenom</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>pentium</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>n270</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>athlon</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 14 04:22:22.772923 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Haswell</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='AMD'>EPYC</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 14 04:22:22.773598 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <model usable='yes' vendor='unknown'>486</model>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </mode>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>vmvga</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>qxl</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>ramfb</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.774189 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <tpm supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>tpm-tis</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>tpm-crb</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>passthrough</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>emulator</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>external</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='backendVersion'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>1.2</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>2.0</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </tpm>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='yes'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <genid supported='yes'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:     <hyperv supported='yes'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:       <enum name='features'>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>relaxed</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>vapic</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>spinlocks</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>vpindex</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>runtime</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>synic</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>stimer</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>reset</value>
May 14 04:22:22.775359 np0000000747 nova-compute[97971]:         <value>vendor_id</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>frequencies</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>reenlightenment</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>tlbflush</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>ipi</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>avic</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     </hyperv>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.776579 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.776579 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 14 04:22:22.776579 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-xtensa</path>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <machine>sim</machine>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <arch>xtensa</arch>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <vcpu max='4'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.776579 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.777529 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.778760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=97971) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 14 04:22:22.778760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 14 04:22:22.778760 np0000000747 nova-compute[97971]: <domainCapabilities>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <domain>qemu</domain>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <machine>sim</machine>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <arch>xtensaeb</arch>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <vcpu max='4'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <iothreads supported='yes'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <os supported='yes'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <enum name='firmware'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <loader supported='yes'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>rom</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>pflash</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='readonly'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>yes</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       <enum name='secure'>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:         <value>no</value>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     </loader>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   </os>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   <cpu>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <mode name='host-passthrough' supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <mode name='maximum' supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <mode name='host-model' supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:     <mode name='custom' supported='no'/>
May 14 04:22:22.778760 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:   <memoryBacking supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <enum name='sourceType'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <value>file</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <value>anonymous</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <value>memfd</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:   </memoryBacking>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:   <devices>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <disk supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='diskDevice'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>disk</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>cdrom</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>floppy</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>lun</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>fdc</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>sata</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </disk>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <graphics supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>sdl</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>vnc</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>spice</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>egl-headless</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>dbus</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <video supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='modelType'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>vga</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>cirrus</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>none</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>bochs</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </video>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <hostdev supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='mode'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>subsystem</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='startupPolicy'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>default</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>mandatory</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>requisite</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>optional</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='subsysType'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>pci</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>scsi</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='capsType'/>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='pciBackend'/>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </hostdev>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <rng supported='yes'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio-transitional</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>virtio-non-transitional</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>random</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>egd</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     </rng>
May 14 04:22:22.779721 np0000000747 nova-compute[97971]:     <filesystem supported='yes'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='driverType'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>path</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>handle</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>virtiofs</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     </filesystem>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <tpm supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <redirdev supported='yes'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='bus'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>usb</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     </redirdev>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <channel supported='yes'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>pty</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>unix</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>spicevmc</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     </channel>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <crypto supported='yes'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='model'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>virtio</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='type'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>qemu</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       <enum name='backendModel'>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:         <value>builtin</value>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:       </enum>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     </crypto>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:   </devices>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:   <features>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <gic supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <vmcoreinfo supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <genid supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <backingStoreInput supported='yes'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <backup supported='yes'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <async-teardown supported='yes'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <sev supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:     <sgx supported='no'/>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:   </features>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]: </domainCapabilities>
May 14 04:22:22.781107 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 14 04:22:22.781107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Checking secure boot support for host arch (x86_64) {{(pid=97971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 04:22:22.781107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Checking secure boot support for host arch (x86_64) {{(pid=97971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 04:22:22.781107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Checking secure boot support for host arch (x86_64) {{(pid=97971) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 14 04:22:22.782083 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Secure Boot support detected
May 14 04:22:23.242515 np0000000747 nova-compute[97971]: INFO nova.virt.node [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Generated node identity 31f323e6-64de-412b-a8c9-20c9194ab897
May 14 04:22:23.242683 np0000000747 nova-compute[97971]: INFO nova.virt.node [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Wrote node identity 31f323e6-64de-412b-a8c9-20c9194ab897 to /opt/stack/data/nova/compute_id
May 14 04:22:23.745192 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Compute nodes ['31f323e6-64de-412b-a8c9-20c9194ab897'] for host np0000000747 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 14 04:22:24.748526 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 14 04:22:25.752751 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] No compute node record found for host np0000000747. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000747 could not be found.
May 14 04:22:25.753300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:22:25.753300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:22:25.753300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:22:25.753300 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:22:25.805408 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:22:25.806108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:22:25.819880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:22:25.820253 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=16643MB free_disk=75.22411727905273GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:22:25.820376 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:22:25.820679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:22:26.323113 np0000000747 nova-compute[97971]: WARNING nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] No compute node record for np0000000747:31f323e6-64de-412b-a8c9-20c9194ab897: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 31f323e6-64de-412b-a8c9-20c9194ab897 could not be found.
May 14 04:22:26.827029 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Compute node record created for np0000000747:np0000000747 with uuid: 31f323e6-64de-412b-a8c9-20c9194ab897
May 14 04:22:28.333041 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:22:28.333487 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:22:25 up 22 min,  2 users,  load average: 2.42, 1.56, 0.76\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:22:28.770340 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] [req-49dc86bd-859c-4c3b-bae2-4ba9ece1bf81] Created resource provider record via placement API for resource provider with UUID 31f323e6-64de-412b-a8c9-20c9194ab897 and name np0000000747.
May 14 04:22:28.821227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 14 04:22:28.821227 np0000000747 nova-compute[97971]: ] {{(pid=97971) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 14 04:22:28.821379 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.host [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] kernel doesn't support AMD SEV
May 14 04:22:28.821574 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:22:28.821777 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:22:28.822030 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:22:28.826061 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Libvirt baseline CPU <cpu>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:   <arch>x86_64</arch>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:   <model>Nehalem</model>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:   <vendor>AMD</vendor>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:   <topology sockets="12" cores="1" threads="1"/>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:   <maxphysaddr mode="emulate" bits="40"/>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]: </cpu>
May 14 04:22:28.826061 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 14 04:22:29.404275 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Updated inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 14 04:22:29.404695 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Updating resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 generation from 0 to 1 during operation: update_inventory {{(pid=97971) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 14 04:22:29.404695 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:22:29.529977 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Updating resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 generation from 1 to 2 during operation: update_traits {{(pid=97971) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 14 04:22:30.037663 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:22:30.037780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.217s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:22:30.037979 np0000000747 nova-compute[97971]: DEBUG nova.service [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=97971) start /opt/stack/nova/nova/service.py:195}}
May 14 04:22:30.052391 np0000000747 nova-compute[97971]: DEBUG nova.service [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=97971) start /opt/stack/nova/nova/service.py:211}}
May 14 04:22:30.066691 np0000000747 nova-compute[97971]: DEBUG nova.service [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] Join ServiceGroup membership for this service compute {{(pid=97971) start /opt/stack/nova/nova/service.py:221}}
May 14 04:22:30.066930 np0000000747 nova-compute[97971]: DEBUG nova.servicegroup.drivers.db [None req-12603757-d862-47bb-aef3-630c6d935eb4 None None] DB_Driver: join new ServiceGroup member np0000000747 to the compute group, service = <Service: host=np0000000747, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=97971) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 14 04:22:35.570103 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:22:46.068685 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:22:46.571925 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:22:46.572692 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.04 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:23:09.610857 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.611266 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.611266 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.611460 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.611746 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.611944 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.612340 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:09.612340 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:23:09.612674 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:23:10.115755 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:23:10.116726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:23:10.116726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:23:10.116726 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:23:10.124441 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:23:10.124441 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:23:10.138397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:23:10.139061 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=16389MB free_disk=75.09263610839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:23:10.139384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:23:10.139801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:23:11.194648 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:23:11.194648 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:23:10 up 23 min,  2 users,  load average: 1.65, 1.48, 0.77\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:23:11.255829 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:23:11.255829 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:23:11.759648 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:23:12.263288 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:23:12.263288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.123s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:23:12.264101 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:24:12.254760 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.255291 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.255291 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.255605 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.255875 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.256137 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.256406 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.256681 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.256896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:24:12.257123 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:24:12.760634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:12.760779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:12.760832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:12.760980 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:24:12.767755 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:24:12.768411 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:12.781067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:12.781781 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=16379MB free_disk=74.88921737670898GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:24:12.781915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:12.782108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:13.827942 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:24:13.828263 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:24:12 up 24 min,  2 users,  load average: 1.22, 1.38, 0.79\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:24:13.871100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:13.871412 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:14.374067 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:14.879626 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:24:14.880055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:14.880055 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:24:35.573907 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:24:40.922487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:40.922487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:41.391935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:41.392031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:41.428034 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:24:41.486498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:41.486498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:41.894195 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:24:41.988371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:24:41.992654 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:41.992814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:41.996549 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:24:41.996768 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Claim successful on node np0000000747
May 14 04:24:42.444251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:42.545985 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:43.196295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:43.196677 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:43.699713 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:44.205862 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.213s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:44.206353 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:24:44.212110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.768s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:44.215743 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:24:44.216060 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Claim successful on node np0000000747
May 14 04:24:44.718983 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:24:44.718983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:24:44.720170 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:44.722608 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:45.227732 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:24:45.438143 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e2981eaaa334996912cedae5d7757da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f5cd5a00b64eab8642956b8f115b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:24:45.488492 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:45.488492 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:45.735329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:24:45.993175 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:46.517532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.305s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:46.518063 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:24:46.520916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.975s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:46.526514 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:24:46.526754 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Claim successful on node np0000000747
May 14 04:24:46.745231 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:24:46.746344 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:24:46.746589 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Creating image(s)
May 14 04:24:46.747425 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:46.747425 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:46.748863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:46.749112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:46.749501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:47.026513 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:24:47.027217 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:24:47.028696 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:47.028696 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:47.110745 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:47.114169 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:47.114542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:47.201244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.part --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:47.201894 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] 61ff7b79-8a72-479d-a718-78041e1efa4d was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:24:47.202568 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:24:47.202886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.part /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:47.354493 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.part /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.converted" returned: 0 in 0.151s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:47.360792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:47.424040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155.converted --force-share --output=json" returned: 0 in 0.064s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:47.425378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.675s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:47.425378 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:47.428929 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:47.430038 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7n0zyg92/privsep.sock']
May 14 04:24:47.439505 np0000000747 sudo[109463]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7n0zyg92/privsep.sock
May 14 04:24:47.440506 np0000000747 sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 04:24:47.530388 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:24:47.643069 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8ede1ead104b17957a4b8b20b80d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6680b6e8f4e4852b7d9bb1f67e84fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:24:47.712451 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 04:24:47.712588 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:24:47.712588 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:24:47.712672 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:47.713379 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:24:47.713379 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:24:47.713379 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:24:47.713379 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:47.713379 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 04:24:47.794909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:47.795397 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:47.966874 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Successfully created port: 72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:24:48.034715 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:24:48.074143 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 04:24:48.074143 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:24:48.074320 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:24:48.074320 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:48.074320 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:24:48.074558 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:24:48.074558 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:24:48.074558 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:48.074558 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 04:24:48.302245 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:48.322735 np0000000747 sudo[109463]: pam_unix(sudo:session): session closed for user root
May 14 04:24:48.324409 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Spawned new privsep daemon via rootwrap
May 14 04:24:48.325283 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 14 04:24:48.325382 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 14 04:24:48.325554 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 14 04:24:48.325606 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109475
May 14 04:24:48.430781 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:48.501994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.071s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:48.502770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:48.503216 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:48.504132 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:48.507261 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:48.507665 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:48.580533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:48.581314 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:48.606863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk 1073741824" returned: 0 in 0.025s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:48.607264 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.104s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:48.607580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:48.679631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.071s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:48.679631 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:24:48.679833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:48.761195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:48.761626 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Cannot resize image /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:24:48.762223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:24:48.762392 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Ensure instance console log exists: /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:24:48.762720 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:48.762930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:48.763079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:48.810038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.289s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:48.810513 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:24:49.047566 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:24:49.048782 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:24:49.049036 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Creating image(s)
May 14 04:24:49.050743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:49.050957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:49.051914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:49.052407 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:49.055490 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:49.057279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:49.116943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:49.117439 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:49.117902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:49.118445 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:49.123162 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:49.123162 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:49.189940 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Successfully updated port: 72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:24:49.210533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:49.210740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:49.247140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk 1073741824" returned: 0 in 0.036s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:49.247140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.129s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:49.247338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:49.320407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:49.323860 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:24:49.324084 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:24:49.328348 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:24:49.328348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:49.334796 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:49.336103 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:49.409293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Cannot resize image /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Ensure instance console log exists: /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:49.411042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:49.696092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:49.696092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquired lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:49.696092 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:24:49.820600 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Successfully created port: cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:24:49.827274 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:24:50.057678 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a9f12c806cf4682a13e57b5866d94df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ff321993c84c0d9681976a6cce4a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:24:50.331687 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:24:50.593876 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Successfully updated port: cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:24:50.864766 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:24:51.098982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:51.098982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:51.098982 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:24:51.114782 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-changed-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:51.114936 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Refreshing instance network info cache due to event network-changed-72fbfa18-6721-4660-a80c-fdf91c2c758d. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:24:51.115951 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] Acquiring lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:51.343917 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:24:51.345078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:24:51.345409 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Creating image(s)
May 14 04:24:51.346011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:51.346235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:51.346933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:51.347471 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:51.352984 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:51.354639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:51.429210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:51.429608 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:51.430670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:51.433672 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:51.434597 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:24:51.435097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:51.503463 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Successfully created port: 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:24:51.505789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.071s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:51.506177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:51.532446 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk 1073741824" returned: 0 in 0.026s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:51.533080 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.102s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:51.533473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:51.611722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.078s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:51.612117 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:24:51.612335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:51.689563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:51.689908 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Cannot resize image /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:24:51.690255 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:24:51.690420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Ensure instance console log exists: /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:24:51.692097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:51.692097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:51.692097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:52.082416 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Successfully updated port: 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:24:52.356376 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:24:52.432729 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:52.593280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:52.595180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:52.595180 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:24:53.222033 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updating instance_info_cache with network_info: [{"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:53.283500 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:24:53.342882 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:53.358416 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:53.358550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing instance network info cache due to event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:24:53.358799 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Acquiring lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:53.415523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:53.416743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:53.566921 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updating instance_info_cache with network_info: [{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:53.578095 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:53.732669 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Releasing lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:53.734546 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Instance network_info: |[{"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:24:53.737906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] Acquired lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:53.737906 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Refreshing network info cache for port 72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:24:53.738119 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Start _get_guest_xml network_info=[{"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:24:53.740478 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:24:53.742765 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-136644901', uuid='751c9f9b-6010-466c-b158-0d29f4b48ecb'), owner=OwnerMeta(userid='4e2981eaaa334996912cedae5d7757da', username='tempest-DeleteServersTestJSON-1902086793-project-member', projectid='f9f5cd5a00b64eab8642956b8f115b22', projectname='tempest-DeleteServersTestJSON-1902086793'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732693.7419326) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:24:53.745941 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:24:53.748066 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:24:53.750234 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:24:53.750393 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:24:53.752644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:24:53.752789 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:24:53.753558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:24:53.753558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:24:53.753558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:24:53.753726 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:24:53.753879 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:24:53.754401 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:24:53.754401 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:24:53.755379 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:24:53.755379 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:24:53.755379 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:24:53.774821 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:24:53.776280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-136644901',display_name='tempest-DeleteServersTestJSON-server-136644901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-deleteserverstestjson-server-136644901',id=1,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f5cd5a00b64eab8642956b8f115b22',ramdisk_id='',reservation_id='r-eb3onwrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1902086793',owner_user_name='tempest-DeleteServersTestJSON-1902086793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:46Z,user_data=None,user_id='4e2981eaaa334996912cedae5d7757da',uuid=751c9f9b-6010-466c-b158-0d29f4b48ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:24:53.776591 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converting VIF {"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:53.777941 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:53.781399 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:53.784836 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lazy-loading 'pci_devices' on Instance uuid 751c9f9b-6010-466c-b158-0d29f4b48ecb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:24:53.918158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:24:54.068593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:54.068798 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Instance network_info: |[{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:24:54.069186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Acquired lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:54.069345 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:24:54.072388 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Start _get_guest_xml network_info=[{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:24:54.075760 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:24:54.077261 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-891169852', uuid='fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa'), owner=OwnerMeta(userid='5a8ede1ead104b17957a4b8b20b80d6b', username='tempest-ServerActionsTestOtherA-1166153365-project-member', projectid='c6680b6e8f4e4852b7d9bb1f67e84fe6', projectname='tempest-ServerActionsTestOtherA-1166153365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732694.0769525) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:24:54.078309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:24:54.078855 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:24:54.079426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:24:54.079599 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:24:54.080315 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:24:54.081059 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:24:54.081059 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:24:54.081059 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:24:54.081316 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:24:54.081316 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:24:54.081316 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:24:54.081434 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:24:54.081519 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:24:54.081653 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:24:54.081748 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:24:54.081909 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:24:54.094153 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-891169852',display_name='tempest-ServerActionsTestOtherA-server-891169852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-891169852',id=2,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-bfn00h5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:24:54.094399 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:54.094888 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:54.095412 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'pci_devices' on Instance uuid fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:24:54.245659 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:54.289156 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:54.289608 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance network_info: |[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:24:54.291380 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start _get_guest_xml network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:24:54.293423 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] End _get_guest_xml xml=<domain type="qemu">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <uuid>751c9f9b-6010-466c-b158-0d29f4b48ecb</uuid>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <name>instance-00000001</name>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:name>tempest-DeleteServersTestJSON-server-136644901</nova:name>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:24:53</nova:creationTime>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:user uuid="4e2981eaaa334996912cedae5d7757da">tempest-DeleteServersTestJSON-1902086793-project-member</nova:user>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:project uuid="f9f5cd5a00b64eab8642956b8f115b22">tempest-DeleteServersTestJSON-1902086793</nova:project>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         <nova:port uuid="72fbfa18-6721-4660-a80c-fdf91c2c758d">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <system>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="serial">751c9f9b-6010-466c-b158-0d29f4b48ecb</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="uuid">751c9f9b-6010-466c-b158-0d29f4b48ecb</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </system>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <os>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </os>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <features>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </features>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   <devices>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.config"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:38:9c:12"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <target dev="tap72fbfa18-67"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </interface>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/console.log" append="off"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </serial>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <video>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </video>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </rng>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:   </devices>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]: </domain>
May 14 04:24:54.293423 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:24:54.295981 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Preparing to wait for external event network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:24:54.295981 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:54.295981 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:54.295981 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:54.295981 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-136644901',display_name='tempest-DeleteServersTestJSON-server-136644901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-deleteserverstestjson-server-136644901',id=1,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f5cd5a00b64eab8642956b8f115b22',ramdisk_id='',reservation_id='r-eb3onwrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1902086793',owner_user_name='tempest-DeleteServersTestJSON-1902086793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:46Z,user_data=None,user_id='4e2981eaaa334996912cedae5d7757da',uuid=751c9f9b-6010-466c-b158-0d29f4b48ecb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:24:54.296409 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converting VIF {"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:54.296409 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:54.296777 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:24:54.298102 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:24:54.299092 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-438362794', uuid='46c1f391-bb33-4215-9e23-0d7999c5fc87'), owner=OwnerMeta(userid='5a9f12c806cf4682a13e57b5866d94df', username='tempest-ServerActionsTestOtherB-1774572299-project-member', projectid='f5ff321993c84c0d9681976a6cce4a8e', projectname='tempest-ServerActionsTestOtherB-1774572299'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732694.2988157) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:24:54.302610 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:24:54.303903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:24:54.306554 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:24:54.307386 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:24:54.308345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:24:54.309000 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:24:54.309000 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:24:54.309888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:24:54.309888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:24:54.309888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:24:54.309888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:24:54.310079 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:24:54.310169 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:24:54.310770 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:24:54.310770 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:24:54.310770 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:24:54.328935 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:24:54.329203 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:54.330102 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:54.330828 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:24:54.377804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Created schema index Interface.name {{(pid=97971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 04:24:54.378041 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Created schema index Port.name {{(pid=97971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 04:24:54.378639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Created schema index Bridge.name {{(pid=97971) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 14 04:24:54.379251 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:24:54.379448 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [POLLOUT] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.379558 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:24:54.380583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.383517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.410038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.437131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.441360 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.442165 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:24:54.444016 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.444016 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c484e544-e17f-5383-87e9-7034680f080e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.447461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:54.448650 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpf0baba3g/privsep.sock']
May 14 04:24:54.457558 np0000000747 sudo[109587]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpf0baba3g/privsep.sock
May 14 04:24:54.458450 np0000000747 sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 04:24:54.506243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:54.506511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:54.509546 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:24:54.509750 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Claim successful on node np0000000747
May 14 04:24:54.573747 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:54.598668 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] End _get_guest_xml xml=<domain type="qemu">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <uuid>fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa</uuid>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <name>instance-00000002</name>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherA-server-891169852</nova:name>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:24:54</nova:creationTime>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:user uuid="5a8ede1ead104b17957a4b8b20b80d6b">tempest-ServerActionsTestOtherA-1166153365-project-member</nova:user>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:project uuid="c6680b6e8f4e4852b7d9bb1f67e84fe6">tempest-ServerActionsTestOtherA-1166153365</nova:project>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         <nova:port uuid="cc91f949-0929-4282-a5c9-6ae4147a7c9e">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <system>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="serial">fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="uuid">fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </system>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <os>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </os>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <features>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </features>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   <devices>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.config"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:dd:d4:ea"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <target dev="tapcc91f949-09"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </interface>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/console.log" append="off"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </serial>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <video>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </video>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </rng>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:   </devices>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]: </domain>
May 14 04:24:54.598668 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:24:54.605466 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Preparing to wait for external event network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:24:54.605466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:54.605466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:54.605466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:54.605466 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-891169852',display_name='tempest-ServerActionsTestOtherA-server-891169852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-891169852',id=2,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-bfn00h5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.607198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdc203f5-02b8-5d56-8601-1ab14adc7e62', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.608493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:54.769434 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 04:24:54.769569 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:24:54.769651 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:24:54.769859 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:54.769859 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:24:54.769991 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:24:54.769991 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:24:54.770078 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:54.770161 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 04:24:54.836776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] End _get_guest_xml xml=<domain type="qemu">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <uuid>46c1f391-bb33-4215-9e23-0d7999c5fc87</uuid>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <name>instance-00000003</name>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherB-server-438362794</nova:name>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:24:54</nova:creationTime>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:user uuid="5a9f12c806cf4682a13e57b5866d94df">tempest-ServerActionsTestOtherB-1774572299-project-member</nova:user>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:project uuid="f5ff321993c84c0d9681976a6cce4a8e">tempest-ServerActionsTestOtherB-1774572299</nova:project>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         <nova:port uuid="5088963d-83e8-4f8a-afab-b4d7c1a9b5c5">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <system>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="serial">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="uuid">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </system>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <os>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </os>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <features>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </features>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   <devices>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </disk>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e5:d2:fb"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <target dev="tap5088963d-83"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </interface>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/console.log" append="off"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </serial>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <video>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </video>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </rng>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:   </devices>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]: </domain>
May 14 04:24:54.836776 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:24:54.841410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Preparing to wait for external event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:24:54.841410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:54.841410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:54.841410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:54.841410 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.841991 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:24:54.842983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.843126 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb85651e-e26e-55d5-876b-4161a471977e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:54.843725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:54.844363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:54.845690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.106638 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 04:24:55.106820 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:24:55.106875 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:24:55.106920 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:55.106964 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:24:55.107008 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:24:55.107050 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:24:55.107094 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:24:55.107145 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 04:24:55.247744 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:55.366227 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:55.369393 np0000000747 sudo[109587]: pam_unix(sudo:session): session closed for user root
May 14 04:24:55.375053 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Spawned new privsep daemon via rootwrap
May 14 04:24:55.377308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:55.377517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:55.378607 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 14 04:24:55.378607 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 14 04:24:55.378607 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 14 04:24:55.378607 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109597
May 14 04:24:55.380725 np0000000747 nova-compute[97971]: WARNING oslo_privsep.priv_context [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] privsep daemon already running
May 14 04:24:55.381363 np0000000747 nova-compute[97971]: WARNING oslo_privsep.priv_context [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] privsep daemon already running
May 14 04:24:55.624064 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updated VIF entry in instance network info cache for port 72fbfa18-6721-4660-a80c-fdf91c2c758d. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:24:55.624393 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updating instance_info_cache with network_info: [{"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:55.689829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.753554 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updated VIF entry in instance network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:24:55.753554 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updating instance_info_cache with network_info: [{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:55.788871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.789737 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc91f949-09, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.790470 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc91f949-09, col_values=(('qos', UUID('4344be96-52de-47c4-b5b0-ac656d8ae328')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.791270 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc91f949-09, col_values=(('external_ids', {'iface-id': 'cc91f949-0929-4282-a5c9-6ae4147a7c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:d4:ea', 'vm-uuid': 'fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.797330 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:55.802960 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.803851 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.803979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fbfa18-67, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.805653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72fbfa18-67, col_values=(('qos', UUID('7c3a9156-8ebb-477e-ae53-055bcf9c5150')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.805653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72fbfa18-67, col_values=(('external_ids', {'iface-id': '72fbfa18-6721-4660-a80c-fdf91c2c758d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:9c:12', 'vm-uuid': '751c9f9b-6010-466c-b158-0d29f4b48ecb'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.806424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.807925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:55.808986 np0000000747 nova-compute[97971]: INFO os_vif [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09')
May 14 04:24:55.817378 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.818396 np0000000747 nova-compute[97971]: INFO os_vif [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67')
May 14 04:24:55.818864 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.819035 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5088963d-83, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.819333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5088963d-83, col_values=(('qos', UUID('b7b429e9-190d-4aa9-870d-66ffc295faa6')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.819455 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5088963d-83, col_values=(('external_ids', {'iface-id': '5088963d-83e8-4f8a-afab-b4d7c1a9b5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:d2:fb', 'vm-uuid': '46c1f391-bb33-4215-9e23-0d7999c5fc87'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:24:55.823935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:24:55.839008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:55.840520 np0000000747 nova-compute[97971]: INFO os_vif [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:24:55.880183 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:24:55.914095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:55.914367 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:56.130522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0eb627b9-6d0e-4ece-8e85-2ee63319cd80 req-d4e92aa4-6466-4bab-94f3-cf3e6c326db8 service nova] Releasing lock "refresh_cache-751c9f9b-6010-466c-b158-0d29f4b48ecb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:56.170651 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:56.255231 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Releasing lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:56.255581 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-changed-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:56.255683 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Refreshing instance network info cache due to event network-changed-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:24:56.255898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:56.256047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:56.256221 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Refreshing network info cache for port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:24:56.416882 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:56.440444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:56.615584 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:56.740832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:56.741100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:56.742092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:56.742092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:56.742092 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] No event matching network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d in dict_keys([('network-vif-plugged', '72fbfa18-6721-4660-a80c-fdf91c2c758d')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:24:56.742092 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5a962575-aa9a-4f80-808c-81e6e1b18186 req-f81ba473-4e66-4ec7-a10d-28d48344e09d service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received unexpected event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d for instance with vm_state building and task_state spawning.
May 14 04:24:56.758786 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:56.924205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.418s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:56.924704 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:24:56.927361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.485s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:56.932278 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:24:56.932864 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Claim successful on node np0000000747
May 14 04:24:57.104428 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.307028 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updated VIF entry in instance network info cache for port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:24:57.307460 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:57.339630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.339803 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.339946 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:dd:d4:ea, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:24:57.342053 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Using config drive
May 14 04:24:57.345499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.345499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.345499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No VIF found with MAC fa:16:3e:38:9c:12, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:24:57.345499 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Using config drive
May 14 04:24:57.361868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.363026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:24:57.363184 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No VIF found with MAC fa:16:3e:e5:d2:fb, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:24:57.363717 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Using config drive
May 14 04:24:57.434930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:24:57.435192 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:24:57.435534 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.435904 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.593954 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd07db15ee9344fe48a33da6399cfe47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8279e74b07d4298a1edd1e0e903e655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:24:57.809449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c7a24ae-f0e5-4d18-9d16-90dab6353df8 req-255de9c0-2262-49d3-86e7-e3a5d0ee0dab service nova] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:24:57.848245 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.853244 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.875278 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:57.941639 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 14 04:24:58.104950 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Successfully created port: eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:24:58.224352 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Creating config drive at /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config
May 14 04:24:58.230482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy74844yn {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:58.261914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy74844yn" returned: 0 in 0.031s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:58.271828 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Creating config drive at /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.config
May 14 04:24:58.276527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkpzxgjk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:58.305213 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkpzxgjk" returned: 0 in 0.028s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:58.317651 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:24:58.318090 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:24:58.808562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:24:58.808562 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Creating config drive at /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.config
May 14 04:24:58.808562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuq03pigg {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:24:58.808562 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Successfully updated port: eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:24:58.808562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuq03pigg" returned: 0 in 0.033s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:24:58.821899 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:24:58.988920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.041475 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:59.042002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:59.042202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:59.042326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:59.042465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] No event matching network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e in dict_keys([('network-vif-plugged', 'cc91f949-0929-4282-a5c9-6ae4147a7c9e')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:24:59.042624 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received unexpected event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e for instance with vm_state building and task_state spawning.
May 14 04:24:59.042747 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-changed-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:24:59.042857 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Refreshing instance network info cache due to event network-changed-eab89968-1a53-4a5e-9dcc-204401711164. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:24:59.042994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Acquiring lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:59.043110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Acquired lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:24:59.043232 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Refreshing network info cache for port eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:24:59.257925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:24:59.330968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.406s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:59.331533 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:24:59.408891 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.438956 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.462000 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:24:59.463296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:24:59.463567 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Creating image(s)
May 14 04:24:59.464078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:59.464255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:59.464920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:24:59.465207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "413f3896a119a88a873661cd0e8324cab8c793ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:24:59.465570 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "413f3896a119a88a873661cd0e8324cab8c793ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:24:59.504194 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.526088 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.528175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.545911 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:59.608764 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.623581 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.635351 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:24:59.746106 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.766401 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.768533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.839820 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:24:59.840010 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:24:59.840256 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:59.840467 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:24:59.893684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:24:59.914777 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:24:59.974929 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1156e930feac4ac08980d240f4d88656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19cb9c493fed4ce588a9753d844b0f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:25:00.031197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:00.343629 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:25:00.421653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69d14657-0707-436d-98d9-303b1ac94dd9 req-28e05589-eb2d-492d-83a5-eb5107d41f8b service nova] Releasing lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:00.422299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquired lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:00.422792 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:25:00.612966 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:00.617640 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:00.618129 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:00.691646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:00.699371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.part --force-share --output=json" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:00.701259 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] 2321a84f-3cd6-4e03-9366-cb8c8ade19eb was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:25:00.702937 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:25:00.703298 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.part /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:00.822016 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:00.852971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:25:00.917830 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.part /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.converted" returned: 0 in 0.214s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:00.924846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:00.966013 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Successfully created port: e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:25:00.984280 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:00.985687 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:00.985975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:00.986188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:00.987339 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No event matching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 in dict_keys([('network-vif-plugged', '5088963d-83e8-4f8a-afab-b4d7c1a9b5c5')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:25:00.987339 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b2ec2d96-5ed1-4b9e-991b-0dd4ce6a53a3 req-99e36587-2ede-42dd-b617-1eb842a4502c service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state building and task_state spawning.
May 14 04:25:00.994890 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778732700.9939222, 751c9f9b-6010-466c-b158-0d29f4b48ecb => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:00.994890 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] VM Started (Lifecycle Event)
May 14 04:25:01.029810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce.converted --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.032141 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:01.035467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "413f3896a119a88a873661cd0e8324cab8c793ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.570s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.035995 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.041812 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.043327 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.119182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json" returned: 0 in 0.075s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.120484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "413f3896a119a88a873661cd0e8324cab8c793ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.121241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "413f3896a119a88a873661cd0e8324cab8c793ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.124648 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.125683 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.126292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.226859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.230789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce,backing_fmt=raw /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.274466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce,backing_fmt=raw /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk 1073741824" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.275068 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "413f3896a119a88a873661cd0e8324cab8c793ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.275473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.318360 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:01.359774 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/413f3896a119a88a873661cd0e8324cab8c793ce --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.368420 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:25:01.369785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.460589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.460981 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Cannot resize image /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:25:01.461293 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:25:01.461446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Ensure instance console log exists: /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:25:01.461789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.462002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.462193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.500265 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:01.503677 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732701.5033092, 751c9f9b-6010-466c-b158-0d29f4b48ecb => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:01.503859 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] VM Paused (Lifecycle Event)
May 14 04:25:01.533463 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating instance_info_cache with network_info: [{"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:01.637974 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:01.639604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.639814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.640039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.640722 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Processing event network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:01.641233 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:01.645048 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] No waiting events found dispatching network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received unexpected event network-vif-plugged-72fbfa18-6721-4660-a80c-fdf91c2c758d for instance with vm_state building and task_state spawning.
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Processing event network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.652869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] No waiting events found dispatching network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:01.653424 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-059af50f-cc96-40e6-8c9f-62a0bbde5795 req-55bcb550-080c-4e3a-ad77-cfb8bbcf55a4 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received unexpected event network-vif-plugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e for instance with vm_state building and task_state spawning.
May 14 04:25:01.653424 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:01.653424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:01.659255 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Instance spawned successfully.
May 14 04:25:01.662676 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:01.662676 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:01.667220 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Instance spawned successfully.
May 14 04:25:01.670538 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:01.873014 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:25:01.874861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:25:01.875029 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Creating image(s)
May 14 04:25:01.876127 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.876340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.877540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:01.879028 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.886083 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.888803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:01.974976 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:01.976087 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:01.976793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:01.978144 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.983171 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:01.984054 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:02.009392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:02.023652 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732702.0228617, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:02.023652 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Started (Lifecycle Event)
May 14 04:25:02.036242 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Releasing lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:02.036723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance network_info: |[{"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:25:02.038656 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Start _get_guest_xml network_info=[{"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:24:43Z,direct_url=<?>,disk_format='qcow2',id=2321a84f-3cd6-4e03-9366-cb8c8ade19eb,min_disk=0,min_ram=0,name='',owner='d9a504a2dd894da1935d17759d13f35b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:24:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '2321a84f-3cd6-4e03-9366-cb8c8ade19eb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:25:02.040563 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:02.041975 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2321a84f-3cd6-4e03-9366-cb8c8ade19eb', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1575982223', uuid='3d2065cf-55ce-4795-9b83-3cfb61c69b07'), owner=OwnerMeta(userid='d07db15ee9344fe48a33da6399cfe47c', username='tempest-AttachSCSIVolumeTestJSON-1685092360-project-member', projectid='c8279e74b07d4298a1edd1e0e903e655', projectname='tempest-AttachSCSIVolumeTestJSON-1685092360'), image=ImageMeta(id='2321a84f-3cd6-4e03-9366-cb8c8ade19eb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732702.041557) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:25:02.043089 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:25:02.044662 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:25:02.045541 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:25:02.045793 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:25:02.047047 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:25:02.047451 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:24:43Z,direct_url=<?>,disk_format='qcow2',id=2321a84f-3cd6-4e03-9366-cb8c8ade19eb,min_disk=0,min_ram=0,name='',owner='d9a504a2dd894da1935d17759d13f35b',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:24:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:25:02.047585 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:25:02.047697 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:25:02.047878 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:25:02.047933 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:25:02.048229 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:25:02.048229 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:25:02.048321 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:25:02.048558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:25:02.048709 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:25:02.048852 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:25:02.074784 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1575982223',display_name='tempest-AttachSCSIVolumeTestJSON-server-1575982223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachscsivolumetestjson-server-1575982223',id=4,image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQpeuiWXraQssFKTZVxyy78919K9by+0ldNA+L/lhsJdUjDZ2YD5ifZIU61IuLWZc31kqGnUdjI1Ebf3ai/Uek3MikhIR2nxvP7ukhA8hjCnCZJqmEKI18wrHUz13dbHg==',key_name='tempest-keypair-729998820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8279e74b07d4298a1edd1e0e903e655',ramdisk_id='',reservation_id='r-0s8edpn2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1685092360',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1685092360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07db15ee9344fe48a33da6399cfe47c',uuid=3d2065cf-55ce-4795-9b83-3cfb61c69b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:25:02.075105 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converting VIF {"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:02.076476 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:02.077213 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:02.096492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:02.099174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:02.123824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.133990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk 1073741824" returned: 0 in 0.035s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:02.134463 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:02.134831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:02.152030 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Successfully updated port: e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:25:02.176653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.176653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.176653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.176653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.176653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.177206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.185642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.186028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.186629 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.187028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.187392 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.187850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:02.225946 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:02.226855 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:25:02.226855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:02.319686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:02.320218 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Cannot resize image /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:25:02.320720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:25:02.320991 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Ensure instance console log exists: /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:25:02.321646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:02.321716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:02.322807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:02.447546 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.449639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.457136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.473121 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.529803 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:02.531816 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732702.5315785, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:02.533806 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Paused (Lifecycle Event)
May 14 04:25:02.580487 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] End _get_guest_xml xml=<domain type="qemu">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <uuid>3d2065cf-55ce-4795-9b83-3cfb61c69b07</uuid>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <name>instance-00000004</name>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1575982223</nova:name>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:25:02</nova:creationTime>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:image uuid="2321a84f-3cd6-4e03-9366-cb8c8ade19eb">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:user uuid="d07db15ee9344fe48a33da6399cfe47c">tempest-AttachSCSIVolumeTestJSON-1685092360-project-member</nova:user>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:project uuid="c8279e74b07d4298a1edd1e0e903e655">tempest-AttachSCSIVolumeTestJSON-1685092360</nova:project>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="2321a84f-3cd6-4e03-9366-cb8c8ade19eb"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         <nova:port uuid="eab89968-1a53-4a5e-9dcc-204401711164">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <system>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="serial">3d2065cf-55ce-4795-9b83-3cfb61c69b07</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="uuid">3d2065cf-55ce-4795-9b83-3cfb61c69b07</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </system>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <os>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </os>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <features>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </features>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   <devices>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <target dev="sda" bus="scsi"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <address type="drive" controller="0" unit="0"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.config"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <target dev="sdb" bus="scsi"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <address type="drive" controller="0" unit="1"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:3e:dd:d5"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <target dev="tapeab89968-1a"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </interface>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/console.log" append="off"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </serial>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <video>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </video>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </rng>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:   </devices>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]: </domain>
May 14 04:25:02.580487 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:25:02.583000 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Preparing to wait for external event network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:25:02.583000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:02.583000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:02.583000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:02.583000 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1575982223',display_name='tempest-AttachSCSIVolumeTestJSON-server-1575982223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachscsivolumetestjson-server-1575982223',id=4,image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQpeuiWXraQssFKTZVxyy78919K9by+0ldNA+L/lhsJdUjDZ2YD5ifZIU61IuLWZc31kqGnUdjI1Ebf3ai/Uek3MikhIR2nxvP7ukhA8hjCnCZJqmEKI18wrHUz13dbHg==',key_name='tempest-keypair-729998820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8279e74b07d4298a1edd1e0e903e655',ramdisk_id='',reservation_id='r-0s8edpn2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1685092360',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1685092360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07db15ee9344fe48a33da6399cfe47c',uuid=3d2065cf-55ce-4795-9b83-3cfb61c69b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:25:02.583589 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converting VIF {"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:02.583798 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:02.584048 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:25:02.585031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.585031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:02.585430 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:25:02.586001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.586277 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4322a3e0-65cf-549c-8829-d33fb708d418', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:02.587212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.588263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:02.592281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.592281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeab89968-1a, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:02.592666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeab89968-1a, col_values=(('qos', UUID('d64b74da-ef24-4804-abe2-ddb85c895ddf')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:02.592850 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeab89968-1a, col_values=(('external_ids', {'iface-id': 'eab89968-1a53-4a5e-9dcc-204401711164', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:dd:d5', 'vm-uuid': '3d2065cf-55ce-4795-9b83-3cfb61c69b07'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:02.594888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.597062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:02.600499 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:02.601576 np0000000747 nova-compute[97971]: INFO os_vif [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a')
May 14 04:25:02.657269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:02.657269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquired lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:02.657269 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:25:02.688508 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Took 15.94 seconds to spawn the instance on the hypervisor.
May 14 04:25:02.688508 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:02.695957 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Took 13.65 seconds to spawn the instance on the hypervisor.
May 14 04:25:02.695957 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:03.040632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:03.041923 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:03.085504 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:03.086130 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:03.086366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:03.086519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:03.086705 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] No event matching network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 in dict_keys([('network-vif-plugged', 'eab89968-1a53-4a5e-9dcc-204401711164')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:25:03.086836 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received unexpected event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 for instance with vm_state building and task_state spawning.
May 14 04:25:03.086934 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:03.087051 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:03.087186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:03.087289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:03.087896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Processing event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:03.087896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:03.087896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:03.087896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:03.088272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:03.088272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:03.088866 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-441adcfa-a81e-40d4-8194-db84360857b9 req-2b791b8b-be6c-48b0-b581-44b52ef240f3 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state building and task_state spawning.
May 14 04:25:03.089714 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:03.093040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:03.097198 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance spawned successfully.
May 14 04:25:03.097198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:03.207210 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Took 21.28 seconds to build instance.
May 14 04:25:03.209077 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Took 20.81 seconds to build instance.
May 14 04:25:03.245448 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:03.257561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.265313 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.267514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.289673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.486374 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:03.549639 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:03.549639 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732703.5469067, fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:03.549639 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] VM Started (Lifecycle Event)
May 14 04:25:03.603197 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.604178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.604178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.604178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.604178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.604354 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:03.711904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6466f381-f304-42fe-94b4-891ea1f4c995 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.789s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:03.712355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ee47927f-b8e6-44a6-9d6b-15e359ace72d tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.320s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:03.765815 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating instance_info_cache with network_info: [{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:03.769325 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.771008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.777740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.797593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-changed-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:03.798965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Refreshing instance network info cache due to event network-changed-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:03.799199 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] Acquiring lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:03.800356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:03.804048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.051758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:04.052894 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:04.110449 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Took 12.77 seconds to spawn the instance on the hypervisor.
May 14 04:25:04.110449 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:04.126384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No BDM found with device name sda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:04.126520 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:04.126721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No VIF found with MAC fa:16:3e:3e:dd:d5, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:04.127176 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Using config drive
May 14 04:25:04.270146 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Releasing lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:04.270517 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Instance network_info: |[{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:25:04.276638 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Start _get_guest_xml network_info=[{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:25:04.276638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] Acquired lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:04.276638 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Refreshing network info cache for port e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:04.284026 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:04.288716 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1524007842', uuid='7c1d2411-c23f-4714-9642-993e0931cd44'), owner=OwnerMeta(userid='1156e930feac4ac08980d240f4d88656', username='tempest-VolumesAssistedSnapshotsTest-718717706-project-member', projectid='19cb9c493fed4ce588a9753d844b0f98', projectname='tempest-VolumesAssistedSnapshotsTest-718717706'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732704.2881126) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:25:04.289687 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:25:04.290115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:25:04.292107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:25:04.292107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:25:04.294437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:25:04.294815 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:25:04.294924 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:25:04.295018 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:25:04.295162 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:25:04.295278 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:25:04.319550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1524007842',display_name='tempest-VolumesAssistedSnapshotsTest-server-1524007842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesassistedsnapshotstest-server-1524007842',id=5,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIatJyZLgUXBy7e87V7TAlRodK+NUEIt/GyhTZ3psgC7/qxlBBEevV2VskVWS6kbcD8EPeMR+jpl0+EB5OtiUIFp9u9FESzo6n31bI5WGv5FUHgjRxK/n6B+L/wYiR4Y2g==',key_name='tempest-keypair-289926181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cb9c493fed4ce588a9753d844b0f98',ramdisk_id='',reservation_id='r-jy0000h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-718717706',owner_user_name='tempest-VolumesAssistedSnapshotsTest-718717706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1156e930feac4ac08980d240f4d88656',uuid=7c1d2411-c23f-4714-9642-993e0931cd44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:25:04.319758 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converting VIF {"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:04.321667 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:04.321667 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:04.557993 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732704.55648, fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:04.557993 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] VM Paused (Lifecycle Event)
May 14 04:25:04.618474 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Took 22.12 seconds to build instance.
May 14 04:25:04.634249 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:04.687484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:04.688068 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:04.779593 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:04.813172 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Creating config drive at /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.config
May 14 04:25:04.818996 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4998aelk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:04.833571 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] End _get_guest_xml xml=<domain type="qemu">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <uuid>7c1d2411-c23f-4714-9642-993e0931cd44</uuid>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <name>instance-00000005</name>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1524007842</nova:name>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:25:04</nova:creationTime>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:user uuid="1156e930feac4ac08980d240f4d88656">tempest-VolumesAssistedSnapshotsTest-718717706-project-member</nova:user>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:project uuid="19cb9c493fed4ce588a9753d844b0f98">tempest-VolumesAssistedSnapshotsTest-718717706</nova:project>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         <nova:port uuid="e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <system>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="serial">7c1d2411-c23f-4714-9642-993e0931cd44</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="uuid">7c1d2411-c23f-4714-9642-993e0931cd44</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </system>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <os>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </os>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <features>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </features>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   <devices>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.config"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:5c:cb:a1"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <target dev="tape7ebe9d4-0b"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </interface>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/console.log" append="off"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </serial>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <video>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </video>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </rng>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:   </devices>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]: </domain>
May 14 04:25:04.833571 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:25:04.839695 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Preparing to wait for external event network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:25:04.839695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:04.839695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:04.839695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:04.839695 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1524007842',display_name='tempest-VolumesAssistedSnapshotsTest-server-1524007842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesassistedsnapshotstest-server-1524007842',id=5,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIatJyZLgUXBy7e87V7TAlRodK+NUEIt/GyhTZ3psgC7/qxlBBEevV2VskVWS6kbcD8EPeMR+jpl0+EB5OtiUIFp9u9FESzo6n31bI5WGv5FUHgjRxK/n6B+L/wYiR4Y2g==',key_name='tempest-keypair-289926181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cb9c493fed4ce588a9753d844b0f98',ramdisk_id='',reservation_id='r-jy0000h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-718717706',owner_user_name='tempest-VolumesAssistedSnapshotsTest-718717706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1156e930feac4ac08980d240f4d88656',uuid=7c1d2411-c23f-4714-9642-993e0931cd44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:25:04.840143 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converting VIF {"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:04.840143 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:04.841510 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:25:04.841654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.842106 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:04.842364 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:25:04.844102 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.844294 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f01798c8-af39-5c50-9146-a7a09d3ae28e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:04.845192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.845909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:04.851941 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4998aelk" returned: 0 in 0.033s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:04.861994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.864254 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.864427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7ebe9d4-0b, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:04.864832 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7ebe9d4-0b, col_values=(('qos', UUID('81aecbcb-b562-4ada-a122-6206e4141fd5')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:04.865009 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7ebe9d4-0b, col_values=(('external_ids', {'iface-id': 'e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:cb:a1', 'vm-uuid': '7c1d2411-c23f-4714-9642-993e0931cd44'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:04.866130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.867841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:04.877906 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:04.879301 np0000000747 nova-compute[97971]: INFO os_vif [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b')
May 14 04:25:05.062667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:05.065965 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732705.06487, 751c9f9b-6010-466c-b158-0d29f4b48ecb => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:05.066113 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] VM Resumed (Lifecycle Event)
May 14 04:25:05.120355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9bc903e4-b5a1-4f79-8e80-ccb6e2806e35 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.634s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:05.139181 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.155470 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:05.191397 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lazy-loading 'flavor' on Instance uuid 751c9f9b-6010-466c-b158-0d29f4b48ecb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:05.382397 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.420192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.448229 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updated VIF entry in instance network info cache for port e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:05.448752 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating instance_info_cache with network_info: [{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:05.544378 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.570958 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:05.579042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:05.691657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.755852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.770871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.799959 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.807208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:05.946945 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:05.950744 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing instance network info cache due to event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:05.950744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] Acquiring lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:05.950744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] Acquired lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:05.950744 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:05.957668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82d72a65-bbc9-49cf-a8ff-95c8942cca38 req-c7a99d23-57f5-4a40-814e-57575a6bd5ef service nova] Releasing lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:06.081215 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732706.0808692, fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:06.081355 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] VM Resumed (Lifecycle Event)
May 14 04:25:06.199011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:06.412012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:06.412012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:06.412012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] No VIF found with MAC fa:16:3e:5c:cb:a1, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:06.412012 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Using config drive
May 14 04:25:06.456401 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:06.588761 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:06.593590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:06.926027 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:07.096660 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732707.0963006, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:07.096884 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Resumed (Lifecycle Event)
May 14 04:25:07.230153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:07.599388 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Creating config drive at /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.config
May 14 04:25:07.601276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:07.603269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:07.608473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpun0gzkpn {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:07.652709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpun0gzkpn" returned: 0 in 0.044s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:07.800516 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:08.025506 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updated VIF entry in instance network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:08.025506 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updating instance_info_cache with network_info: [{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:08.041110 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-changed-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:08.042810 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Refreshing instance network info cache due to event network-changed-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:08.043573 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:08.043753 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:08.046165 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Refreshing network info cache for port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:08.110650 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732708.1071086, 3d2065cf-55ce-4795-9b83-3cfb61c69b07 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:08.110650 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] VM Started (Lifecycle Event)
May 14 04:25:08.170994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:08.171280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:08.171545 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Attaching volume b1a7a639-2737-42ec-b357-94ac0d618105 to /dev/vdb
May 14 04:25:08.174664 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.207441 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.257001 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:08.260724 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpx1s_3pe5/privsep.sock']
May 14 04:25:08.270432 np0000000747 sudo[110333]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpx1s_3pe5/privsep.sock
May 14 04:25:08.272070 np0000000747 sudo[110333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 14 04:25:08.287595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.528341 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-50a5e89c-380b-4b8d-b699-59f8e5c5db3a req-e7a702f1-00ca-404a-a081-a1d02da9f8b2 service nova] Releasing lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:08.553005 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:08.562351 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.570866 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:25:08.583371 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 14 04:25:08.595067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:08.611982 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:08.624226 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732708.622675, 3d2065cf-55ce-4795-9b83-3cfb61c69b07 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:08.624226 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] VM Paused (Lifecycle Event)
May 14 04:25:09.000725 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 14 04:25:09.000883 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 14 04:25:09.000921 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 14 04:25:09.002259 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:25:09.002669 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 14 04:25:09.002669 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 14 04:25:09.002669 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 14 04:25:09.002669 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log: 
May 14 04:25:09.002669 np0000000747 nova-compute[97971]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 14 04:25:09.044434 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:09.130097 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:09.131940 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:09.245545 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updated VIF entry in instance network info cache for port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:09.245545 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:09.290709 np0000000747 sudo[110333]: pam_unix(sudo:session): session closed for user root
May 14 04:25:09.292705 np0000000747 nova-compute[97971]: INFO oslo.privsep.daemon [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Spawned new privsep daemon via rootwrap
May 14 04:25:09.437292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:25:09.437662 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.nvmeof [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 14 04:25:09.464522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:09.484982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:25:09.485327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:25:09.496944 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:25:09.498450 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe38:9c12', 'fe80::fc16:3eff:fee5:d2fb', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::54b8:5fff:fe69:3247', 'fe80::e47b:a2ff:fe54:552c', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe3e:ddd5', 'fe80::18e3:2fff:fe8a:b6f4', 'fe80::fc16:3eff:fe5c:cba1', 'fe80::604e:a4ff:fe7c:c11'] 
May 14 04:25:09.498701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:25:09.498828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:25:09.499150 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] <== get_connector_properties: return (1239ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:09.499429 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updating existing volume attachment record: 4417ba57-b8ed-40dc-b29f-b44d480690c9 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:25:09.635510 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:09.636061 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732709.63574, 7c1d2411-c23f-4714-9642-993e0931cd44 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:09.636239 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] VM Started (Lifecycle Event)
May 14 04:25:09.747793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a198505-46d0-4cd5-be00-afb4c6d98f89 req-968b3aac-014d-4358-9854-d1649699e241 service nova] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:09.867538 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:10.092194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:10.092194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:10.095462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connector [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Factory for ISCSI on None {{(pid=97971) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 14 04:25:10.095462 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:10.095462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:25:10.096888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:10.097752 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:10.098089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:10.098693 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:10.100685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:25:10.116972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:10.118287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:10.119000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:10.122549 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:10.122549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:10.122835 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:10.133487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:10.133487 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:10.139849 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:10.141467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:10.141467 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:10.142548 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732710.1422544, 7c1d2411-c23f-4714-9642-993e0931cd44 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:10.142939 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] VM Paused (Lifecycle Event)
May 14 04:25:10.154339 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:10.154573 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:10.155993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:10.156201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:10.156464 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Processing event network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:10.156464 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:10.156668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:10.157092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105] added
May 14 04:25:10.157092 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:10.157092 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:10.157092 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:10.157092 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:10.157092 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:10.157092 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:10.157459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:10.158678 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:10.159815 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:10.160521 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:10.160796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:10.160992 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:10.161160 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] No waiting events found dispatching network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:10.163169 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-eb4b8916-a9cf-42e7-bcf4-502128f8f7ec req-260c2fb6-de68-4985-85d1-d192fa63076f service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received unexpected event network-vif-plugged-eab89968-1a53-4a5e-9dcc-204401711164 for instance with vm_state building and task_state spawning.
May 14 04:25:10.163810 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:10.165261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105] added
May 14 04:25:10.165261 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:10.165261 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:10.165261 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:10.165261 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:10.165261 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:10.165261 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:10.166261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:10.166261 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:10.166261 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:10.167027 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance spawned successfully.
May 14 04:25:10.167581 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:10.170370 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:10.171331 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:10.171850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:10.172356 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:10.649835 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:10.651762 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:10.680819 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Took 11.22 seconds to spawn the instance on the hypervisor.
May 14 04:25:10.680956 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:10.696932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:11.155041 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:11.155308 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732711.1551232, 3d2065cf-55ce-4795-9b83-3cfb61c69b07 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:11.155429 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] VM Resumed (Lifecycle Event)
May 14 04:25:11.162636 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:11.166846 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:11.178598 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:11.178598 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:11.192542 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:11.192542 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.195092 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Took 16.77 seconds to build instance.
May 14 04:25:11.199822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.207525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.221495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.221495 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:11.221637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.221637 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:11.228355 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.228355 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:11.228586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.228586 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:11.265669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.40.100,3260]
May 14 04:25:11.265669 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.40.100,3260] successful.
May 14 04:25:11.265669 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.279584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:11.292672 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.292672 np0000000747 nova-compute[97971]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:11.292672 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:11.292888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:11.292888 np0000000747 nova-compute[97971]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:11.292888 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:11.293220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:11.293408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:11.294925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] HCTL ('8', '-', '-', 0) found on session 3 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:11.295066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:11.312134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Searching for a device in session 3 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:11.312134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:11.452253 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:11.659265 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:11.663813 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:11.700811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5cf1626e-1f5b-409e-a2bb-e27c71a399c7 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.285s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:12.273678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.50.100,3260]
May 14 04:25:12.273678 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.50.100,3260] successful.
May 14 04:25:12.273678 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:12.286721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:12.306381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:12.306381 np0000000747 nova-compute[97971]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:12.306381 np0000000747 nova-compute[97971]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:12.306381 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:12.306552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85f38bd-6141-44ef-b538-345aca32b33f (non-flash)
May 14 04:25:12.306552 np0000000747 nova-compute[97971]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:12.306552 np0000000747 nova-compute[97971]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:12.306552 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:12.306776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.188s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:12.306901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:12.307395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] HCTL ('9', '-', '-', 0) found on session 4 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:12.307492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:12.327348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Searching for a device in session 4 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:12.329348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:13.136136 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-changed-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:13.137108 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Refreshing instance network info cache due to event network-changed-eab89968-1a53-4a5e-9dcc-204401711164. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:13.137308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] Acquiring lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:13.137421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] Acquired lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:13.137683 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Refreshing network info cache for port eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:13.151644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:25:13.322956 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:13.640330 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:14.176936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798918 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:25:14.177428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.079s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:14.177428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] <== connect_volume: return (4079ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798918', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798918'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:14.177567 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798918', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798918'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:25:14.183411 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lazy-loading 'flavor' on Instance uuid 751c9f9b-6010-466c-b158-0d29f4b48ecb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:14.198647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:14.363130 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:14.627422 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updated VIF entry in instance network info cache for port eab89968-1a53-4a5e-9dcc-204401711164. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:14.630837 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating instance_info_cache with network_info: [{"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:14.686913 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Attempting to attach volume b1a7a639-2737-42ec-b357-94ac0d618105 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:25:14.687358 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:   <alias name="ua-b1a7a639-2737-42ec-b357-94ac0d618105"/>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:   <serial>b1a7a639-2737-42ec-b357-94ac0d618105</serial>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]: </disk>
May 14 04:25:14.687358 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:25:14.869935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:14.880993 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.881297 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.881904 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.883095 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.883417 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.883660 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.883915 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:14.884167 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:25:14.884402 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:25:15.135458 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce84a2e9-e233-4725-8529-4a32d702155a req-e9a9963d-4a3d-44ed-9fbc-4f556b203b7d service nova] Releasing lock "refresh_cache-3d2065cf-55ce-4795-9b83-3cfb61c69b07" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:15.171197 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d33d33c3-52a7-4084-b02e-ec4f0d363395 req-19a2db51-eace-4711-9f73-1e32c5fea9a2 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:15.175017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d33d33c3-52a7-4084-b02e-ec4f0d363395 req-19a2db51-eace-4711-9f73-1e32c5fea9a2 service nova] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:15.175134 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d33d33c3-52a7-4084-b02e-ec4f0d363395 req-19a2db51-eace-4711-9f73-1e32c5fea9a2 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:15.175330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d33d33c3-52a7-4084-b02e-ec4f0d363395 req-19a2db51-eace-4711-9f73-1e32c5fea9a2 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:15.175745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d33d33c3-52a7-4084-b02e-ec4f0d363395 req-19a2db51-eace-4711-9f73-1e32c5fea9a2 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Processing event network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:15.176732 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:15.183822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:15.185292 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732715.1847463, 7c1d2411-c23f-4714-9642-993e0931cd44 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:15.185292 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] VM Resumed (Lifecycle Event)
May 14 04:25:15.192632 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Instance spawned successfully.
May 14 04:25:15.192632 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:15.390067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:15.390842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:15.391060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:15.391459 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:25:15.694643 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:15.697913 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:15.704754 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:15.708314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:15.708451 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:15.708847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:15.709135 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:15.709415 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:15.709707 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:16.208317 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:16.215487 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Took 14.34 seconds to spawn the instance on the hypervisor.
May 14 04:25:16.215823 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:16.366735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:16.368635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:16.368635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:16.368635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] No VIF found with MAC fa:16:3e:38:9c:12, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:16.425769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.499931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.500602 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.577603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.582703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.664936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.667601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.729806 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Took 20.35 seconds to build instance.
May 14 04:25:16.748738 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.749661 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:25:16.753541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.827427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.828863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:16.931138 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:16.933897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:17.025009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:17.025009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:17.113039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:17.120201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:17.220796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:17.221734 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:17.236302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.858s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:17.275301 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:17.280032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:17.282608 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:17.282608 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:17.282608 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] No waiting events found dispatching network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:17.282608 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-a6949b8f-d616-40ed-b70c-6b9bd5b2737a req-3d28ac22-fd93-4ccd-a669-21fd3cd3d334 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received unexpected event network-vif-plugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba for instance with vm_state active and task_state None.
May 14 04:25:17.321861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:17.324275 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:17.325585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:17.355232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.029s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:17.355884 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13894MB free_disk=74.73112487792969GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:25:17.356412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:17.356412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:17.960293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e42b946-45e9-4be1-82e0-045e5873ec65 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.789s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:18.066299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:18.066501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:18.443746 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 751c9f9b-6010-466c-b158-0d29f4b48ecb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:25:18.444189 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:25:18.444189 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 46c1f391-bb33-4215-9e23-0d7999c5fc87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:25:18.444189 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:25:18.444189 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7c1d2411-c23f-4714-9642-993e0931cd44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:25:18.573703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:25:18.946509 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 04:25:18.946806 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:25:18.946880 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:25:17 up 25 min,  2 users,  load average: 5.29, 2.47, 1.21\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_f9f5cd5a00b64eab8642956b8f115b22': '1', 'io_workload': '0', 'num_proj_c6680b6e8f4e4852b7d9bb1f67e84fe6': '1', 'num_proj_f5ff321993c84c0d9681976a6cce4a8e': '1', 'num_proj_c8279e74b07d4298a1edd1e0e903e655': '1', 'num_proj_19cb9c493fed4ce588a9753d844b0f98': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:25:18.979026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:18.979026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:18.979026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:18.979026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:18.979026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:18.983270 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Terminating instance
May 14 04:25:19.158110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:19.312131 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:19.312416 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:19.364868 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-changed-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:19.364868 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Refreshing instance network info cache due to event network-changed-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:19.364868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] Acquiring lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:19.364868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] Acquired lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:19.364868 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Refreshing network info cache for port e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:19.488476 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:25:19.509375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.531852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.546476 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.575652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.582674 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.632386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] No waiting events found dispatching network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:19.799655 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49681eba-a7b2-45b9-a8eb-57cd7f4367b6 req-592457e7-0611-4e09-8de8-b4a1f0407c9b service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:25:19.818128 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:19.831643 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998600979000003 future=<Future at 0x7436183dc8c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:19.831643 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997599714999978 future=<Future at 0x7436183dc8c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:19.831643 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997446439999976 future=<Future at 0x7436183dc8c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:19.833578 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Instance destroyed successfully.
May 14 04:25:19.834425 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lazy-loading 'resources' on Instance uuid 751c9f9b-6010-466c-b158-0d29f4b48ecb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:19.869073 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:19.875640 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.211240 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:20.325815 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:25:20.326031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.970s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:20.326411 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.169s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:20.326846 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.72 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:25:20.330025 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:25:20.330174 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Claim successful on node np0000000747
May 14 04:25:20.337337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-136644901',display_name='tempest-DeleteServersTestJSON-server-136644901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-deleteserverstestjson-server-136644901',id=1,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:02Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f5cd5a00b64eab8642956b8f115b22',ramdisk_id='',reservation_id='r-eb3onwrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1902086793',owner_user_name='tempest-DeleteServersTestJSON-1902086793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:25:03Z,user_data=None,user_id='4e2981eaaa334996912cedae5d7757da',uuid=751c9f9b-6010-466c-b158-0d29f4b48ecb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:25:20.337565 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converting VIF {"id": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "address": "fa:16:3e:38:9c:12", "network": {"id": "5a08d3c8-ca1d-4764-b672-4dfce2dc354b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-230114781-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f9f5cd5a00b64eab8642956b8f115b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbfa18-67", "ovs_interfaceid": "72fbfa18-6721-4660-a80c-fdf91c2c758d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:20.339073 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:20.339073 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:25:20.344712 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.344712 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fbfa18-67, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:20.346876 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.348413 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:20.349718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.351124 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c3a9156-8ebb-477e-ae53-055bcf9c5150) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:20.352357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.352357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:20.353217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.355404 np0000000747 nova-compute[97971]: INFO os_vif [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=72fbfa18-6721-4660-a80c-fdf91c2c758d,network=Network(5a08d3c8-ca1d-4764-b672-4dfce2dc354b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbfa18-67')
May 14 04:25:20.357331 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:25:20.357664 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:20.357790 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:20.358584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:20.358981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1a7a639-2737-42ec-b357-94ac0d618105', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:25:20.359092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:25:20.368794 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updated VIF entry in instance network info cache for port e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:20.369213 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating instance_info_cache with network_info: [{"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:20.386311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:20.386311 np0000000747 nova-compute[97971]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:20.386311 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:20.386536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:20.386536 np0000000747 nova-compute[97971]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105 (non-flash)
May 14 04:25:20.386536 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:20.386536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', '4')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:25:20.386757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', '3')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:25:20.390047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105', '4')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:25:20.391898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618489800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:25:20.392964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Removing multipathed devices sdc, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:25:20.393695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Flush multipath device 330000000e19466e7 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:25:20.424421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:25:20.470329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:25:20.518193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:25:20.518551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:25:20.519486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:25:20.532443 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:25:20.532741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:25:20.546834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.581045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.40.100,3260]
May 14 04:25:20.581045 np0000000747 nova-compute[97971]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.40.100,3260] successful.
May 14 04:25:20.581045 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.594027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.606154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.644875 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.50.100,3260]
May 14 04:25:20.644875 np0000000747 nova-compute[97971]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-b1a7a639-2737-42ec-b357-94ac0d618105, portal: 192.168.50.100,3260] successful.
May 14 04:25:20.644875 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.654346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:20.654573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:20.654788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] <== disconnect_volume: return (297ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:20.654910 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:25:20.655268 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Deleting instance files /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb_del
May 14 04:25:20.655964 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Deletion of /opt/stack/data/nova/instances/751c9f9b-6010-466c-b158-0d29f4b48ecb_del complete
May 14 04:25:20.696856 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:20.871844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a955389e-3261-4bc5-a5f6-3580dbd81227 req-cb1a8d20-a4fe-4a37-85be-2c31e7d924f5 service nova] Releasing lock "refresh_cache-7c1d2411-c23f-4714-9642-993e0931cd44" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:21.164065 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Took 1.68 seconds to destroy the instance on the hypervisor.
May 14 04:25:21.165860 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:25:21.165860 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:25:21.166052 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:25:21.166175 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:21.242854 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:21.266547 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:21.596888 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4910a0dc-0c10-4ab1-ab69-ff20bfd3d309 req-edd30377-b340-44dc-ba69-7b2b0d59be37 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-deleted-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:21.597377 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-4910a0dc-0c10-4ab1-ab69-ff20bfd3d309 req-edd30377-b340-44dc-ba69-7b2b0d59be37 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Neutron deleted interface 72fbfa18-6721-4660-a80c-fdf91c2c758d; detaching it from the instance and deleting it from the info cache
May 14 04:25:21.597377 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4910a0dc-0c10-4ab1-ab69-ff20bfd3d309 req-edd30377-b340-44dc-ba69-7b2b0d59be37 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:21.777580 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:21.777866 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:21.977352 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:21.977415 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] Acquiring lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:21.978066 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:21.978066 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:21.978066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] No waiting events found dispatching network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:21.978066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4df60cd9-faaf-4b31-8454-79f4d2872ff2 req-05aaf435-879b-4345-9144-a09a3c760482 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Received event network-vif-unplugged-72fbfa18-6721-4660-a80c-fdf91c2c758d for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:25:22.025834 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:22.101046 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4910a0dc-0c10-4ab1-ab69-ff20bfd3d309 req-edd30377-b340-44dc-ba69-7b2b0d59be37 service nova] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Detach interface failed, port_id=72fbfa18-6721-4660-a80c-fdf91c2c758d, reason: Instance 751c9f9b-6010-466c-b158-0d29f4b48ecb could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:25:22.281096 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:22.529566 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Took 1.36 seconds to deallocate network for instance.
May 14 04:25:22.790498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.464s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:22.791020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:25:23.047323 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:23.285763 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Took 0.76 seconds to detach 1 volumes for instance.
May 14 04:25:23.301401 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:25:23.301716 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:25:23.302015 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:23.302290 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:23.438946 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d5b93fa488e469cab3d35f0d0283061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d49cec32e7e4e59ab41cd04147db756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:25:23.812529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:23.813372 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:23.816593 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:25:24.016899 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Successfully created port: cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:25:24.179860 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:24.179860 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:24.324643 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:25:24.533434 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Successfully updated port: cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:25:24.606798 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:24.606949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing instance network info cache due to event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:24.607089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:24.607188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:24.607287 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:24.684641 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:25.038900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:25.073312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:25.073312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:25.110050 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:25.172737 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:25.189655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.375s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:25.257491 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Deleted allocations for instance 751c9f9b-6010-466c-b158-0d29f4b48ecb
May 14 04:25:25.332180 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:25:25.333117 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:25:25.333348 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Creating image(s)
May 14 04:25:25.333784 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:25.333943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:25.334345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:25.334822 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:25.337282 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:25.338397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:25.352211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:25.370225 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:25.418140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:25.418736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:25.419234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:25.419748 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:25.422938 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:25.423505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:25.505694 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.080s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:25.505694 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:25.543862 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk 1073741824" returned: 0 in 0.039s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:25.544375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.125s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:25.544741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:25.577316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:25:25.616675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:25.617018 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:25:25.617232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:25.698348 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:25.701222 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:25.701578 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Cannot resize image /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:25:25.701943 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:25:25.702090 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Ensure instance console log exists: /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:25:25.702339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:25.702553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:25.702701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:25.872755 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7febe280-c172-4eb4-96c5-cdd688562ada req-4e88d0cc-da90-494a-b791-335a1d8bed96 service nova] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:25.874828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:25.874828 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:25:26.144609 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:26.145719 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:26.149212 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:25:26.149412 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Claim successful on node np0000000747
May 14 04:25:26.270352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b717d0c9-a447-4c7e-8db9-b6c6e05de674 tempest-DeleteServersTestJSON-1902086793 tempest-DeleteServersTestJSON-1902086793-project-member] Lock "751c9f9b-6010-466c-b158-0d29f4b48ecb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.292s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:26.461705 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:26.625676 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:26.776419 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:27.279342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:27.279342 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance network_info: |[{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:25:27.281048 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start _get_guest_xml network_info=[{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:25:27.284792 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:27.284792 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-745630866', uuid='b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57'), owner=OwnerMeta(userid='5d5b93fa488e469cab3d35f0d0283061', username='tempest-ServerStableDeviceRescueTest-933200266-project-member', projectid='2d49cec32e7e4e59ab41cd04147db756', projectname='tempest-ServerStableDeviceRescueTest-933200266'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732727.2839785) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:25:27.285312 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:25:27.286246 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:25:27.286872 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:25:27.287124 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:25:27.288438 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:25:27.288907 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:25:27.289145 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:25:27.289651 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:25:27.289651 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:25:27.289651 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:25:27.289651 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:25:27.289813 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:25:27.289983 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:25:27.290149 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:25:27.290316 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:25:27.290494 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:25:27.307180 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-745630866',display_name='tempest-ServerStableDeviceRescueTest-server-745630866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverstabledevicerescuetest-server-745630866',id=6,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAci6SWH7DYnU3OQ7wwqiBWjKYBDwI40fqWKHcg0oJjrwHacFR2KTwRhEez9K8yY3e2SxIZYu8+NEs2T6qa3w0GdJzu5BLDCp479vU1b6G1ASQs92vA6WhdycehHbaBZ+A==',key_name='tempest-keypair-1510039878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d49cec32e7e4e59ab41cd04147db756',ramdisk_id='',reservation_id='r-0h085c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-933200266',owner_user_name='tempest-ServerStableDeviceRescueTest-933200266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5b93fa488e469cab3d35f0d0283061',uuid=b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:25:27.307467 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converting VIF {"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:27.308319 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:27.309082 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'pci_devices' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:27.559767 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:27.560200 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:27.813205 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] End _get_guest_xml xml=<domain type="qemu">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <uuid>b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</uuid>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <name>instance-00000006</name>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-745630866</nova:name>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:25:27</nova:creationTime>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:user uuid="5d5b93fa488e469cab3d35f0d0283061">tempest-ServerStableDeviceRescueTest-933200266-project-member</nova:user>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:project uuid="2d49cec32e7e4e59ab41cd04147db756">tempest-ServerStableDeviceRescueTest-933200266</nova:project>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         <nova:port uuid="cb034d60-b075-479f-9b34-57325e1c0d65">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <system>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="serial">b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="uuid">b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </system>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <os>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </os>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <features>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </features>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   <devices>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:40:ab:68"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <target dev="tapcb034d60-b0"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </interface>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/console.log" append="off"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </serial>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <video>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </video>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </rng>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:   </devices>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]: </domain>
May 14 04:25:27.813205 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:25:27.817281 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Preparing to wait for external event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:25:27.817281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:27.817281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:27.817487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:27.817991 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-745630866',display_name='tempest-ServerStableDeviceRescueTest-server-745630866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverstabledevicerescuetest-server-745630866',id=6,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAci6SWH7DYnU3OQ7wwqiBWjKYBDwI40fqWKHcg0oJjrwHacFR2KTwRhEez9K8yY3e2SxIZYu8+NEs2T6qa3w0GdJzu5BLDCp479vU1b6G1ASQs92vA6WhdycehHbaBZ+A==',key_name='tempest-keypair-1510039878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d49cec32e7e4e59ab41cd04147db756',ramdisk_id='',reservation_id='r-0h085c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-933200266',owner_user_name='tempest-ServerStableDeviceRescueTest-933200266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5b93fa488e469cab3d35f0d0283061',uuid=b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:25:27.818144 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converting VIF {"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:27.818834 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:27.819006 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:25:27.820120 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.821334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:27.821334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:25:27.822045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.822366 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '835645b4-9dd1-51aa-8329-27e67993c923', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:27.823308 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.824457 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:27.825461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.830062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.830062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb034d60-b0, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:27.830062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb034d60-b0, col_values=(('qos', UUID('8387f708-07bb-42e4-95bf-4786c5f5eb7f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:27.830062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb034d60-b0, col_values=(('external_ids', {'iface-id': 'cb034d60-b075-479f-9b34-57325e1c0d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:ab:68', 'vm-uuid': 'b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:27.831053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.833883 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:27.838825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:27.840794 np0000000747 nova-compute[97971]: INFO os_vif [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0')
May 14 04:25:28.064300 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:28.571339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.426s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:28.571812 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:25:28.660944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:28.661405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:28.661517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:28.661701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:28.662258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No event matching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 in dict_keys([('network-vif-plugged', 'cb034d60-b075-479f-9b34-57325e1c0d65')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:25:28.662258 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-91efeed8-d168-41ad-8786-93885372c193 req-2d937882-9c9f-4bfa-b504-04f266daee50 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state building and task_state spawning.
May 14 04:25:28.763900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:29.082035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:25:29.082035 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:25:29.082035 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:29.082035 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:29.173949 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aebaf0044eda43c9b72f2d28829e29d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d13fe858e534c5bb2e18f4ec9b7159d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:25:29.364443 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:29.366690 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:29.366690 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No VIF found with MAC fa:16:3e:40:ab:68, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:29.366690 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Using config drive
May 14 04:25:29.582529 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:25:29.730743 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Successfully created port: b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:25:29.874157 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:30.047549 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Creating config drive at /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config
May 14 04:25:30.055836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf3rv5mus {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:30.089348 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:25:30.098116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf3rv5mus" returned: 0 in 0.043s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:30.384533 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Successfully updated port: b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:25:30.465033 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-changed-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:30.465751 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Refreshing instance network info cache due to event network-changed-b4f82a76-46fd-40ea-be02-569a2deb14ee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:30.466155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] Acquiring lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:30.466312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] Acquired lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:30.466474 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Refreshing network info cache for port b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:30.628179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:30.657163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:30.658870 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:30.704697 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:30.768825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:30.838317 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1cc8efc0-41ca-4013-92e4-5825714435e2 req-f2bf592a-182b-44d6-8fdf-8cc6aab4afca service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:30.838967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1cc8efc0-41ca-4013-92e4-5825714435e2 req-f2bf592a-182b-44d6-8fdf-8cc6aab4afca service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:30.839258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1cc8efc0-41ca-4013-92e4-5825714435e2 req-f2bf592a-182b-44d6-8fdf-8cc6aab4afca service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:30.839488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1cc8efc0-41ca-4013-92e4-5825714435e2 req-f2bf592a-182b-44d6-8fdf-8cc6aab4afca service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:30.839734 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1cc8efc0-41ca-4013-92e4-5825714435e2 req-f2bf592a-182b-44d6-8fdf-8cc6aab4afca service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Processing event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:30.887719 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:30.971729 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:30.999517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:31.005366 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:31.021760 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:31.022367 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:31.072038 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:31.100993 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:25:31.102202 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:25:31.102487 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Creating image(s)
May 14 04:25:31.104042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:31.104319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:31.105233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:31.106078 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:31.111338 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:31.114562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:31.205659 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:31.208799 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:31.210468 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:31.211099 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:31.221003 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:31.221419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:31.312960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:31.313572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:31.336683 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:31.361904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk 1073741824" returned: 0 in 0.048s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:31.362854 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:31.363324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:31.459371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:31.459930 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:25:31.460201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:31.540672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:31.541009 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Cannot resize image /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:25:31.541369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:25:31.541631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Ensure instance console log exists: /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:25:31.542039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:31.544234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:31.544496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:31.608146 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:31.608692 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732731.6083386, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:31.608934 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Started (Lifecycle Event)
May 14 04:25:31.611637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:31.616258 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance spawned successfully.
May 14 04:25:31.616870 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:31.841572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121efba1-ea3f-4305-a077-1086a875c747 req-e21ce65a-5353-494d-ae3c-46ee89de66e3 service nova] Releasing lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:31.842184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquired lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:31.842334 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:25:32.115166 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:32.118263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:32.128206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.128376 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.128880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.129176 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.129526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.129949 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:32.433559 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:32.622981 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:32.623428 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732732.6230364, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:32.623482 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Paused (Lifecycle Event)
May 14 04:25:32.640540 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Took 7.31 seconds to spawn the instance on the hypervisor.
May 14 04:25:32.641300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:32.708733 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:32.830718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:32.880636 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Updating instance_info_cache with network_info: [{"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:32.926020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:32.928353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:32.928353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:32.928353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:32.928353 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:32.929423 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9e3a5f4c-643a-4682-844b-f330a6251687 req-b6869ba8-092b-4897-8a13-67a8bf676faa service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state None.
May 14 04:25:33.135122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:33.135695 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732733.1354656, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:33.135911 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Resumed (Lifecycle Event)
May 14 04:25:33.156549 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Took 14.08 seconds to build instance.
May 14 04:25:33.383271 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Releasing lock "refresh_cache-33e5d0cc-e83f-4b14-80c5-77dff5bf4688" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:33.383271 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance network_info: |[{"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:25:33.386311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Start _get_guest_xml network_info=[{"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:25:33.388482 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:33.389759 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1116075775', uuid='33e5d0cc-e83f-4b14-80c5-77dff5bf4688'), owner=OwnerMeta(userid='aebaf0044eda43c9b72f2d28829e29d5', username='tempest-VolumesAdminNegativeTest-1828598956-project-member', projectid='6d13fe858e534c5bb2e18f4ec9b7159d', projectname='tempest-VolumesAdminNegativeTest-1828598956'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732733.3892298) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:25:33.391483 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:25:33.391483 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:25:33.392200 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:25:33.392405 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:25:33.393487 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:25:33.393889 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:25:33.394116 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:25:33.394213 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:25:33.394359 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:25:33.394580 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:25:33.394741 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:25:33.394943 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:25:33.395089 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:25:33.395228 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:25:33.395379 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:25:33.395511 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:25:33.412887 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1116075775',display_name='tempest-VolumesAdminNegativeTest-server-1116075775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesadminnegativetest-server-1116075775',id=7,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d13fe858e534c5bb2e18f4ec9b7159d',ramdisk_id='',reservation_id='r-esqbhgfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1828598956',owner_user_name='tempest-VolumesAdminNegativeTest-1828598956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:30Z,user_data=None,user_id='aebaf0044eda43c9b72f2d28829e29d5',uuid=33e5d0cc-e83f-4b14-80c5-77dff5bf4688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:25:33.413189 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converting VIF {"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:33.413855 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:33.414667 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lazy-loading 'pci_devices' on Instance uuid 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:33.638440 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:33.639784 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:33.662729 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-add2f134-e113-423d-aeba-27a97fc579ed tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.594s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:33.918433 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] End _get_guest_xml xml=<domain type="qemu">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <uuid>33e5d0cc-e83f-4b14-80c5-77dff5bf4688</uuid>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <name>instance-00000007</name>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1116075775</nova:name>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:25:33</nova:creationTime>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:user uuid="aebaf0044eda43c9b72f2d28829e29d5">tempest-VolumesAdminNegativeTest-1828598956-project-member</nova:user>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:project uuid="6d13fe858e534c5bb2e18f4ec9b7159d">tempest-VolumesAdminNegativeTest-1828598956</nova:project>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         <nova:port uuid="b4f82a76-46fd-40ea-be02-569a2deb14ee">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <system>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="serial">33e5d0cc-e83f-4b14-80c5-77dff5bf4688</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="uuid">33e5d0cc-e83f-4b14-80c5-77dff5bf4688</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </system>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <os>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </os>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <features>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </features>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   <devices>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.config"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:7d:19:06"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <target dev="tapb4f82a76-46"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </interface>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/console.log" append="off"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </serial>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <video>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </video>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </rng>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:   </devices>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]: </domain>
May 14 04:25:33.918433 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:25:33.920871 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Preparing to wait for external event network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:25:33.920871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:33.920871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:33.920871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:33.920871 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1116075775',display_name='tempest-VolumesAdminNegativeTest-server-1116075775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesadminnegativetest-server-1116075775',id=7,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d13fe858e534c5bb2e18f4ec9b7159d',ramdisk_id='',reservation_id='r-esqbhgfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1828598956',owner_user_name='tempest-VolumesAdminNegativeTest-1828598956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:30Z,user_data=None,user_id='aebaf0044eda43c9b72f2d28829e29d5',uuid=33e5d0cc-e83f-4b14-80c5-77dff5bf4688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:25:33.921201 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converting VIF {"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:33.921286 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:33.921820 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:25:33.922929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:33.923229 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:33.924444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:25:33.931762 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:33.931762 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eca95902-ada8-585c-8cb4-25d59aed1a8b', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:33.940053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:33.944217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:33.944609 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4f82a76-46, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:33.947290 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4f82a76-46, col_values=(('qos', UUID('57d91c84-bd92-425a-b01d-66f7ce9df485')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:33.948097 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4f82a76-46, col_values=(('external_ids', {'iface-id': 'b4f82a76-46fd-40ea-be02-569a2deb14ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:19:06', 'vm-uuid': '33e5d0cc-e83f-4b14-80c5-77dff5bf4688'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:33.958200 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:33.968370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:33.969155 np0000000747 nova-compute[97971]: INFO os_vif [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46')
May 14 04:25:34.734680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:34.827507 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0009347640000214597 future=<Future at 0x7436183dc8c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:34.827675 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:34.827881 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778732719.8264463, 751c9f9b-6010-466c-b158-0d29f4b48ecb => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:34.827968 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] VM Stopped (Lifecycle Event)
May 14 04:25:34.998707 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:34.999071 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing instance network info cache due to event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:34.999071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:34.999168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:34.999328 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:35.331500 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 751c9f9b-6010-466c-b158-0d29f4b48ecb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:35.499844 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:35.500013 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:35.500049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] No VIF found with MAC fa:16:3e:7d:19:06, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:35.500452 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Using config drive
May 14 04:25:35.501936 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:35.702900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:35.921563 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:36.010551 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:36.111361 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updated VIF entry in instance network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:25:36.111821 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:36.214742 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Creating config drive at /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.config
May 14 04:25:36.218014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3hq8zj6w {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:36.260066 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3hq8zj6w" returned: 0 in 0.042s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:36.615512 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1def3b3-6fad-486e-a1f5-7f45d49f8453 req-56bb4d14-0dc1-4bd4-be12-36bf72669e05 service nova] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:36.737594 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:36.756603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:36.758899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:36.850239 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.111206 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-35854a45-b4da-4bcc-b848-9075af2e2f69 req-bc501bb8-f0dc-46f6-a71d-68021fe58c99 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:37.111206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-35854a45-b4da-4bcc-b848-9075af2e2f69 req-bc501bb8-f0dc-46f6-a71d-68021fe58c99 service nova] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:37.111554 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-35854a45-b4da-4bcc-b848-9075af2e2f69 req-bc501bb8-f0dc-46f6-a71d-68021fe58c99 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:37.111554 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-35854a45-b4da-4bcc-b848-9075af2e2f69 req-bc501bb8-f0dc-46f6-a71d-68021fe58c99 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:37.111659 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-35854a45-b4da-4bcc-b848-9075af2e2f69 req-bc501bb8-f0dc-46f6-a71d-68021fe58c99 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Processing event network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:37.148236 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.149747 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.152214 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.174278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.175641 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:37.676586 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:37.677118 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732737.676846, 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:37.677306 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] VM Started (Lifecycle Event)
May 14 04:25:37.682721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:37.684426 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance spawned successfully.
May 14 04:25:37.684633 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:38.101038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:38.180458 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:38.182258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:38.194107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.194243 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.194645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.195416 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.195830 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.196225 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:38.686739 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:25:38.686958 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732738.6868165, 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:38.687059 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] VM Paused (Lifecycle Event)
May 14 04:25:38.704753 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Took 7.60 seconds to spawn the instance on the hypervisor.
May 14 04:25:38.704753 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:38.952797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:39.190637 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:39.192312 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732739.1920328, 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:39.192456 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] VM Resumed (Lifecycle Event)
May 14 04:25:39.215696 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Took 13.13 seconds to build instance.
May 14 04:25:39.218300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:39.219716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:39.220700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:39.220894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:39.221062 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] No waiting events found dispatching network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:39.221237 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fb586a97-923d-4f68-aa9f-434154f6bbc3 req-1f1249dd-a1c4-4782-a486-fe32b25b98a6 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received unexpected event network-vif-plugged-b4f82a76-46fd-40ea-be02-569a2deb14ee for instance with vm_state active and task_state None.
May 14 04:25:39.698595 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:39.701227 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:39.719011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.646s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:40.704340 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:41.726155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:42.560973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:42.561059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:42.561279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:42.561603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:42.561698 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:42.568832 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Terminating instance
May 14 04:25:43.074658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:25:43.103018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.109803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.131387 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.156307 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.178350 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.413797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.423157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.443556 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999686921000148 future=<Future at 0x7436184d4740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:43.443556 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999493032000146 future=<Future at 0x7436184d4740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:43.443556 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999418093000031 future=<Future at 0x7436184d4740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:43.446234 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Instance destroyed successfully.
May 14 04:25:43.447900 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lazy-loading 'resources' on Instance uuid 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:43.751098 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.951661 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1116075775',display_name='tempest-VolumesAdminNegativeTest-server-1116075775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesadminnegativetest-server-1116075775',id=7,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:38Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d13fe858e534c5bb2e18f4ec9b7159d',ramdisk_id='',reservation_id='r-esqbhgfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1828598956',owner_user_name='tempest-VolumesAdminNegativeTest-1828598956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:25:39Z,user_data=None,user_id='aebaf0044eda43c9b72f2d28829e29d5',uuid=33e5d0cc-e83f-4b14-80c5-77dff5bf4688,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:25:43.952022 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converting VIF {"id": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "address": "fa:16:3e:7d:19:06", "network": {"id": "acfea453-45c7-483d-9d3d-7ab124d37e46", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1641530682-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6d13fe858e534c5bb2e18f4ec9b7159d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f82a76-46", "ovs_interfaceid": "b4f82a76-46fd-40ea-be02-569a2deb14ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:43.953318 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:43.953681 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:25:43.956117 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.956216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.957525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4f82a76-46, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:43.960938 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.962474 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:43.963264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.963568 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.963737 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57d91c84-bd92-425a-b01d-66f7ce9df485) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:43.964992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.964992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:43.965443 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:43.967950 np0000000747 nova-compute[97971]: INFO os_vif [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:19:06,bridge_name='br-int',has_traffic_filtering=True,id=b4f82a76-46fd-40ea-be02-569a2deb14ee,network=Network(acfea453-45c7-483d-9d3d-7ab124d37e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f82a76-46')
May 14 04:25:43.968270 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Deleting instance files /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688_del
May 14 04:25:43.968963 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Deletion of /opt/stack/data/nova/instances/33e5d0cc-e83f-4b14-80c5-77dff5bf4688_del complete
May 14 04:25:44.462604 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:44.463044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:44.463095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:44.464670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:44.464670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] No waiting events found dispatching network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:44.464670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b9caf7d0-f60d-4059-9330-04f6733443d2 req-72b20dae-57b8-4855-9f55-f268b67c4684 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:25:44.476929 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:25:44.477956 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:25:44.478420 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:25:44.478544 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:25:44.478879 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:44.557168 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:44.957007 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c71e018-9b65-466f-af7c-ad4c34b4cdc7 req-243976f6-8c6b-4a32-ba56-9fb2d7048b13 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-deleted-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:44.957807 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-5c71e018-9b65-466f-af7c-ad4c34b4cdc7 req-243976f6-8c6b-4a32-ba56-9fb2d7048b13 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Neutron deleted interface b4f82a76-46fd-40ea-be02-569a2deb14ee; detaching it from the instance and deleting it from the info cache
May 14 04:25:44.957807 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5c71e018-9b65-466f-af7c-ad4c34b4cdc7 req-243976f6-8c6b-4a32-ba56-9fb2d7048b13 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:45.384716 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:45.464577 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c71e018-9b65-466f-af7c-ad4c34b4cdc7 req-243976f6-8c6b-4a32-ba56-9fb2d7048b13 service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Detach interface failed, port_id=b4f82a76-46fd-40ea-be02-569a2deb14ee, reason: Instance 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:25:45.706524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:45.767104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:45.767346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:45.887481 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Took 1.41 seconds to deallocate network for instance.
May 14 04:25:46.269770 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:25:46.395165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:46.395385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:46.567099 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received event network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:46.567609 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] Acquiring lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:46.567609 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:46.568322 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:46.568322 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] No waiting events found dispatching network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:25:46.568322 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2b9231f8-7ad1-4482-a78b-6f704c454727 req-7a5eb89f-0cc3-4a25-99a8-53689c1f54ac service nova] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Received unexpected event network-vif-unplugged-b4f82a76-46fd-40ea-be02-569a2deb14ee for instance with vm_state deleted and task_state None.
May 14 04:25:46.872014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:46.917831 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:46.918143 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:47.048422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:47.049635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:47.421419 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:47.554206 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'flavor' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:47.931084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.536s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:47.932926 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.060s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:47.935605 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:25:47.935927 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Claim successful on node np0000000747
May 14 04:25:48.001831 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Deleted allocations for instance 33e5d0cc-e83f-4b14-80c5-77dff5bf4688
May 14 04:25:48.561092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:48.965745 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:49.012628 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ea27b48-c87a-4165-a9d1-e2efc070c7a6 tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Lock "33e5d0cc-e83f-4b14-80c5-77dff5bf4688" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.451s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:49.380833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:25:49.381007 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:25:49.884236 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:25:50.187150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:50.187701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:50.187701 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attaching volume 37e1df64-4e5a-460c-9776-48fc8b73d1fe to /dev/vdb
May 14 04:25:50.250233 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:50.265510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:25:50.286353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:50.318486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:25:50.318790 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:25:50.329116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:25:50.330590 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fee5:d2fb', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::e47b:a2ff:fe54:552c', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe3e:ddd5', 'fe80::18e3:2fff:fe8a:b6f4', 'fe80::fc16:3eff:fe5c:cba1', 'fe80::604e:a4ff:fe7c:c11', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582'] 
May 14 04:25:50.330743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:25:50.330897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:25:50.331200 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:50.331536 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating existing volume attachment record: df36b603-96f0-485a-ba52-81faa13bb35c {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:25:50.339840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:50.340046 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:50.392112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.461s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:50.392760 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:25:50.709363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:50.844793 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lazy-loading 'flavor' on Instance uuid 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:50.907215 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:25:50.907545 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:25:50.908078 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:50.908949 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:25:50.909504 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:50.910865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:50.912303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:51.037658 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8ede1ead104b17957a4b8b20b80d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6680b6e8f4e4852b7d9bb1f67e84fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:25:51.407521 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:25:51.433121 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:51.612983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Successfully created port: d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:25:51.862072 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:51.911389 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:25:52.315495 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Successfully updated port: d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:25:52.398381 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-changed-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:52.399216 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Refreshing instance network info cache due to event network-changed-d14b0b96-59d7-4fb2-8b83-fb72d95bd884. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:25:52.399562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] Acquiring lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:52.401236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] Acquired lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:52.401236 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Refreshing network info cache for port d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:25:52.822125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:25:52.905657 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:52.920768 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:25:52.921861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:25:52.922115 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating image(s)
May 14 04:25:52.922556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:52.922782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:52.923180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:52.924271 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:52.929058 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:52.931305 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:52.994488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:53.006652 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.075s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:53.006652 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:53.007281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:53.007656 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:53.011775 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:25:53.012280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:53.088661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.076s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:53.089061 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:53.123506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk 1073741824" returned: 0 in 0.033s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:53.123506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:53.123506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:53.190472 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:53.195484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:53.195874 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:25:53.196128 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:53.268777 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:53.269309 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Cannot resize image /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:25:53.269874 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:25:53.270251 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:25:53.271454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:53.271454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:53.271454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:53.298953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:53.299144 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:53.299379 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Attaching volume 882f1f1a-a2e3-415d-8d2c-46e728e0a6cc to /dev/sdc
May 14 04:25:53.347948 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:53.361030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:25:53.382980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:53.408494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:25:53.408863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:25:53.418237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:25:53.419791 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fee5:d2fb', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::e47b:a2ff:fe54:552c', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe3e:ddd5', 'fe80::18e3:2fff:fe8a:b6f4', 'fe80::fc16:3eff:fe5c:cba1', 'fe80::604e:a4ff:fe7c:c11', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582'] 
May 14 04:25:53.419962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:25:53.420070 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:25:53.420404 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:53.420841 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating existing volume attachment record: 08f57056-cada-4566-9d8e-9cb7b0bb2d22 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:25:53.472644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.561s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:53.472644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:25:53.484468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:53.488351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:53.489020 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:53.489396 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:53.489964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:53.490270 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:53.502092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:53.502092 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:53.502996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:53.502996 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:53.513749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:25:53.513749 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:53.513749 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:53.513749 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:53.513749 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:53.513749 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:53.513749 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:53.514047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:53.514047 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:53.515989 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:53.517924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:25:53.517924 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:53.517924 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:53.517924 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:53.517924 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:53.517924 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:53.517924 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:53.518160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:53.518340 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:53.518497 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:53.694196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-509bbafa-30ba-458f-9638-e228ce98dd12 req-85bc7104-eeba-40a8-82d0-efe662893dd7 service nova] Releasing lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:53.694675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:25:53.695071 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:25:53.696817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:53.967244 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:53.985074 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:25:53.985396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:53.985521 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:54.276758 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:25:54.490286 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:54.515008 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:54.519091 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:54.527216 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:54.527216 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:54.535209 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:54.535209 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.543269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.552832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.560064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.560064 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.560064 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:54.560064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.560064 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.560064 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:54.568784 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.568784 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.568784 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:54.568979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.568979 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.568979 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:54.591607 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:25:54.591607 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:25:54.591607 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.605156 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.618852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:25:54.618852 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:25:54.618852 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.624772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.624772 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.624772 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.624772 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.624772 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:54.625243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.625243 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.625243 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.625243 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.625243 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:54.626675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:54.626675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:54.626675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('9', '-', '-', 0) found on session 8 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:54.626675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:54.633315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:54.645423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 8 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:54.645423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:54.650483 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:54.650986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:54.650986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:54.651212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('10', '-', '-', 0) found on session 9 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:54.651309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:54.657309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:54.657451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:54.662681 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating instance_info_cache with network_info: [{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:25:54.681799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 9 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:55.161257 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lazy-loading 'flavor' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:55.164800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:25:55.165140 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance network_info: |[{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:25:55.169421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start _get_guest_xml network_info=[{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:25:55.178106 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:25:55.179491 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-333845418', uuid='eb9bb511-c615-4ea8-9fa3-c784c88a680d'), owner=OwnerMeta(userid='5a8ede1ead104b17957a4b8b20b80d6b', username='tempest-ServerActionsTestOtherA-1166153365-project-member', projectid='c6680b6e8f4e4852b7d9bb1f67e84fe6', projectname='tempest-ServerActionsTestOtherA-1166153365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732755.1789625) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:25:55.181698 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:25:55.182118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:25:55.186968 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:25:55.187212 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:25:55.188341 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:25:55.188721 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:25:55.189035 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:25:55.189035 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:25:55.189264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:25:55.189264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:25:55.189264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:25:55.189437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:25:55.189626 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:25:55.189731 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:25:55.189830 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:25:55.189941 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:25:55.204527 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-tempest.common.compute-instance-333845418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:25:55.204768 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:55.205347 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:55.206974 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'pci_devices' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:55.500762 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.674970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 9 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:55.675172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:55.709594 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] End _get_guest_xml xml=<domain type="qemu">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <uuid>eb9bb511-c615-4ea8-9fa3-c784c88a680d</uuid>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <name>instance-00000008</name>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:name>tempest-tempest.common.compute-instance-333845418</nova:name>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:25:55</nova:creationTime>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:user uuid="5a8ede1ead104b17957a4b8b20b80d6b">tempest-ServerActionsTestOtherA-1166153365-project-member</nova:user>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:project uuid="c6680b6e8f4e4852b7d9bb1f67e84fe6">tempest-ServerActionsTestOtherA-1166153365</nova:project>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         <nova:port uuid="d14b0b96-59d7-4fb2-8b83-fb72d95bd884">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <system>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="serial">eb9bb511-c615-4ea8-9fa3-c784c88a680d</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="uuid">eb9bb511-c615-4ea8-9fa3-c784c88a680d</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </system>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <os>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </os>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <features>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </features>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   <devices>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </disk>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:fb:39:88"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <target dev="tapd14b0b96-59"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </interface>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/console.log" append="off"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </serial>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <video>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </video>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </rng>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:   </devices>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]: </domain>
May 14 04:25:55.709594 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:25:55.712035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Preparing to wait for external event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:25:55.712035 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:55.712035 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:55.712035 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:55.712035 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-tempest.common.compute-instance-333845418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:25:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:25:55.712398 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:25:55.712398 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:25:55.712398 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:25:55.712590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.714094 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:55.714307 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:25:55.715045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.715233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '315d941c-809d-560a-b1ac-8261a0070661', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:55.717391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.718176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:55.719898 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.724708 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.724919 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd14b0b96-59, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:55.725380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd14b0b96-59, col_values=(('qos', UUID('d7ecad04-97e2-4314-8b93-b0ab7ca1c83f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:55.725508 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd14b0b96-59, col_values=(('external_ids', {'iface-id': 'd14b0b96-59d7-4fb2-8b83-fb72d95bd884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:39:88', 'vm-uuid': 'eb9bb511-c615-4ea8-9fa3-c784c88a680d'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:25:55.728609 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:25:55.737188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:55.738806 np0000000747 nova-compute[97971]: INFO os_vif [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59')
May 14 04:25:56.166645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:56.505595 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Found WWN 3300000000e5614a0 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:25:56.505872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:56.506065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== connect_volume: return (5595ms) {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-1', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:56.506211 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-1', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:25:56.506780 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.521s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:56.506854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:25:56.508691 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'flavor' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:56.517276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:56.518071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:56.518468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:56.518690 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:56.519271 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:56.519659 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:56.529262 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:56.529262 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:56.533598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:56.533598 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc] added
May 14 04:25:56.540318 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:56.540318 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:56.540318 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:56.540721 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:56.543135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc] added
May 14 04:25:56.543135 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:56.543135 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:56.543135 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:56.543135 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:56.543135 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:56.543135 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:56.543303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:56.543381 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:56.543496 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:57.011446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attempting to attach volume 37e1df64-4e5a-460c-9776-48fc8b73d1fe with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:25:57.012913 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:   <alias name="ua-37e1df64-4e5a-460c-9776-48fc8b73d1fe"/>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:   <serial>37e1df64-4e5a-460c-9776-48fc8b73d1fe</serial>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]: </disk>
May 14 04:25:57.012913 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:25:57.237930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:57.238299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:57.238385 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Attaching volume 23aec858-f8e8-4bf5-a361-a29c4d13a2d2 to /dev/vdb
May 14 04:25:57.259605 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:57.259743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:57.259879 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:fb:39:88, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:57.260242 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Using config drive
May 14 04:25:57.286986 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:57.297678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:25:57.318527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:57.341638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:25:57.341897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:25:57.365246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:25:57.366771 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fee5:d2fb', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::e47b:a2ff:fe54:552c', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe3e:ddd5', 'fe80::18e3:2fff:fe8a:b6f4', 'fe80::fc16:3eff:fe5c:cba1', 'fe80::604e:a4ff:fe7c:c11', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582'] 
May 14 04:25:57.366877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:25:57.366994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:25:57.367205 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:57.367421 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating existing volume attachment record: 60134361-006c-4fa0-a4f4-75c702470fb6 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:25:57.541133 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:57.544059 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:57.554906 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:57.554906 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:25:57.560982 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:25:57.560982 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.571209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.576093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.584751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.584751 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.584751 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.584751 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.584751 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:57.584939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.584939 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.584939 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.584939 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.584939 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:57.593266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.593266 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.593266 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.593266 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.593266 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:57.593460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsi session list stdout=tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.593460 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.593460 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.593460 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.593460 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:57.620424 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.40.100,3260]
May 14 04:25:57.620424 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.40.100,3260] successful.
May 14 04:25:57.620424 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.633292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.643408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.50.100,3260]
May 14 04:25:57.643408 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.50.100,3260] successful.
May 14 04:25:57.643408 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.651648 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:57.652173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:57.652173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:57.655815 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] HCTL ('11', '-', '-', 0) found on session 10 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:57.655815 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:57.656227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.671065 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:25:57.671251 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:25:57.671926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:57.671926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:25:57.676014 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] HCTL ('12', '-', '-', 0) found on session 11 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:25:57.676014 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:25:57.679516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Searching for a device in session 10 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:57.679759 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:57.698218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Searching for a device in session 11 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:25:57.698435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:25:57.765946 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:25:57.941039 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating config drive at /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config
May 14 04:25:57.945818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1ofddoe7 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:25:57.958978 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:25:57.959588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:25:57.959908 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:57.983023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1ofddoe7" returned: 0 in 0.037s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:25:58.427685 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.443328 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0006280509999214701 future=<Future at 0x7436184d4740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:58.443748 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:25:58.443959 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778732743.442566, 33e5d0cc-e83f-4b14-80c5-77dff5bf4688 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:58.444166 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] VM Stopped (Lifecycle Event)
May 14 04:25:58.457694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.519585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:25:58.547772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.576836 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.578390 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.657709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:25:58.663288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:58.663641 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:58.663641 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:25:58.663774 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No VIF found with MAC fa:16:3e:e5:d2:fb, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:25:58.690970 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-71e0e6d1-ecbf-47e5-81da-9ebdcb570733 req-24a9f188-8626-4c91-b498-12368b887336 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:25:58.692315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-71e0e6d1-ecbf-47e5-81da-9ebdcb570733 req-24a9f188-8626-4c91-b498-12368b887336 service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:25:58.692315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-71e0e6d1-ecbf-47e5-81da-9ebdcb570733 req-24a9f188-8626-4c91-b498-12368b887336 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:25:58.692315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-71e0e6d1-ecbf-47e5-81da-9ebdcb570733 req-24a9f188-8626-4c91-b498-12368b887336 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:25:58.692315 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-71e0e6d1-ecbf-47e5-81da-9ebdcb570733 req-24a9f188-8626-4c91-b498-12368b887336 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Processing event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:25:58.947924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1506cd04-1139-45c4-863d-f80210168025 None None] [instance: 33e5d0cc-e83f-4b14-80c5-77dff5bf4688] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:59.413198 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732759.4126456, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:25:59.413489 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Started (Lifecycle Event)
May 14 04:25:59.417151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:25:59.422873 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:25:59.425975 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance spawned successfully.
May 14 04:25:59.426467 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:25:59.544832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Found WWN 330000000d3680776 for multipath device dm-4 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:25:59.545551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:25:59.545551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] <== connect_volume: return (5559ms) {'type': 'block', 'scsi_wwn': '330000000d3680776', 'path': '/dev/dm-4', 'multipath_id': '330000000d3680776'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:25:59.545551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d3680776', 'path': '/dev/dm-4', 'multipath_id': '330000000d3680776'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:25:59.548414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.586s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:59.548414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:25:59.552086 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lazy-loading 'flavor' on Instance uuid 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:25:59.565918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:59.566973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:25:59.568763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:59.570030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:25:59.572390 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:25:59.573280 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:25:59.588198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:59.588198 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:59.597320 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:25:59.597320 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2] added
May 14 04:25:59.608059 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:59.608059 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:59.608059 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:59.612030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2] added
May 14 04:25:59.612030 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:25:59.612030 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:59.612030 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:59.612030 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:25:59.612030 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:25:59.612030 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:25:59.612276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:25:59.612455 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:25:59.612571 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:25:59.917019 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:25:59.918640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:25:59.935038 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:59.935435 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:59.935477 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:59.935780 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:59.936401 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:25:59.936690 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:00.055925 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <alias name="ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc"/>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <target dev="sdc" bus="scsi"/>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <serial>882f1f1a-a2e3-415d-8d2c-46e728e0a6cc</serial>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:   <address type="drive" controller="0" unit="2"/>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:00.055925 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:26:00.237117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be248950-a254-40d3-a0ae-dee1b4c62edf tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.050s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:00.421338 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:00.421574 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732760.4213629, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:00.421742 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Paused (Lifecycle Event)
May 14 04:26:00.442024 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Took 7.52 seconds to spawn the instance on the hypervisor.
May 14 04:26:00.444731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:00.608308 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:00.613000 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:00.623335 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:00.623335 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:00.632408 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:00.632408 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.637458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.643501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.656968 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.662030 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.662674 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:00.705241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.40.100,3260]
May 14 04:26:00.705241 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.40.100,3260] successful.
May 14 04:26:00.705241 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.714883 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:00.719267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.50.100,3260]
May 14 04:26:00.719267 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.50.100,3260] successful.
May 14 04:26:00.719267 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.720011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.729489 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:00.734440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.746288 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.746471 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:00.747016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:00.747016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:00.748478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] HCTL ('13', '-', '-', 0) found on session 12 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:00.748478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.757082 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:00.757998 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:00.757998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:00.758812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] HCTL ('14', '-', '-', 0) found on session 13 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:00.758907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:00.781422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Searching for a device in session 12 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:00.781422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:00.786740 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Searching for a device in session 13 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:00.786819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:00.831962 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:00.831962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:00.831962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:00.832660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:00.832660 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:00.832660 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-66a7bd3c-ca27-46cc-a294-2d29c8ca3fd2 req-261a9fa0-e5d7-4547-a237-bfc8390665b5 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received unexpected event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with vm_state active and task_state None.
May 14 04:26:00.924759 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:00.933283 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732760.9328916, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:00.933479 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Resumed (Lifecycle Event)
May 14 04:26:00.960179 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Took 14.18 seconds to build instance.
May 14 04:26:01.436319 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:01.438334 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:01.462743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.695s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:01.569413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:01.783814 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No BDM found with device name sda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:01.784180 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No BDM found with device name sdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:01.784180 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No BDM found with device name sdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:01.784329 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] No VIF found with MAC fa:16:3e:3e:dd:d5, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:02.091880 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-changed-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:02.091880 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Refreshing instance network info cache due to event network-changed-d14b0b96-59d7-4fb2-8b83-fb72d95bd884. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:02.091880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] Acquiring lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:02.091880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] Acquired lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:02.091880 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Refreshing network info cache for port d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:02.097071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:02.594359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Found WWN 33000000050a4f080 for multipath device dm-5 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:02.594898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:02.595108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] <== connect_volume: return (4635ms) {'type': 'block', 'scsi_wwn': '33000000050a4f080', 'path': '/dev/dm-5', 'multipath_id': '33000000050a4f080'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:02.596261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000050a4f080', 'path': '/dev/dm-5', 'multipath_id': '33000000050a4f080'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:02.599790 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:02.604402 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lazy-loading 'flavor' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:03.109162 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Attempting to attach volume 23aec858-f8e8-4bf5-a361-a29c4d13a2d2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:26:03.112551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] attach device xml: <disk type="block" device="disk">
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:   <alias name="ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2"/>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:   <serial>23aec858-f8e8-4bf5-a361-a29c4d13a2d2</serial>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:03.112551 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:26:03.275027 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:03.372556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cdd42fba-65d2-4110-87eb-43b0117a1b46 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.073s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:03.393459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:03.619395 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updated VIF entry in instance network info cache for port d14b0b96-59d7-4fb2-8b83-fb72d95bd884. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:26:03.622638 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating instance_info_cache with network_info: [{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:04.124244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-120c881c-5605-430b-a4ca-6d60313e0120 req-acebb9e2-9812-4df0-8366-df7524b9971e service nova] Releasing lock "refresh_cache-eb9bb511-c615-4ea8-9fa3-c784c88a680d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:04.300603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:04.300603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:04.804549 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Detaching volume 882f1f1a-a2e3-415d-8d2c-46e728e0a6cc
May 14 04:26:04.830421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:04.830421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:04.830709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:04.830709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] No VIF found with MAC fa:16:3e:5c:cb:a1, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:04.880250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:04.887134 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Attempting to driver detach volume 882f1f1a-a2e3-415d-8d2c-46e728e0a6cc from mountpoint /dev/sdc
May 14 04:26:04.898435 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Found disk sdc by alias ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:26:04.900405 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Found disk sdc by alias ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:26:04.900601 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Attempting to detach device sdc from instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:26:04.900795 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <alias name="ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc"/>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <target dev="sdc" bus="scsi"/>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <serial>882f1f1a-a2e3-415d-8d2c-46e728e0a6cc</serial>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:04.900795 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:26:04.911022 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Successfully detached device sdc from instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 from the persistent domain config.
May 14 04:26:04.911349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] (1/8): Attempting to detach device sdc with device alias ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc from instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:26:04.911742 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <alias name="ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc"/>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <target dev="sdc" bus="scsi"/>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <serial>882f1f1a-a2e3-415d-8d2c-46e728e0a6cc</serial>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:04.911742 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:26:05.119739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732765.1187181, 3d2065cf-55ce-4795-9b83-3cfb61c69b07 => ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:26:05.120817 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc for instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:26:05.123111 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Successfully detached device sdc from instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 from the live domain config.
May 14 04:26:05.123957 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:26:05.124287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:05.124724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:05.124892 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:05.125233 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:26:05.125405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:05.154787 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:05.155321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '9')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:26:05.155321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', '10')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:05.155730 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Stashing vm_state: active {{(pid=97971) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 04:26:05.160297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc', '11')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:05.161998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184899e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:26:05.162235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:26:05.162676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Flush multipath device 330000000d3680776 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:26:05.210074 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:05.263405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:05.310237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:26:05.310443 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:26:05.311605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:26:05.325356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:26:05.325538 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:26:05.341920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.376872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.40.100,3260]
May 14 04:26:05.376872 np0000000747 nova-compute[97971]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.40.100,3260] successful.
May 14 04:26:05.376872 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.403641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.418871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.459796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.50.100,3260]
May 14 04:26:05.459796 np0000000747 nova-compute[97971]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-882f1f1a-a2e3-415d-8d2c-46e728e0a6cc, portal: 192.168.50.100,3260] successful.
May 14 04:26:05.459796 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.478412 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:05.478770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:05.478975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] <== disconnect_volume: return (354ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:05.479156 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:26:05.715042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:05.715422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:05.716668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:05.731122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:06.061774 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lazy-loading 'flavor' on Instance uuid 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:06.224997 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:06.225442 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Claim successful on node np0000000747
May 14 04:26:06.400240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5117f632-93ef-40e3-8e87-b58a49a1d7c4 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:06.731913 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating resource usage from migration 325dfb3b-1149-42ea-a1b7-8f00af21f013
May 14 04:26:06.941647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:06.941647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:07.069523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ad0e5ea5-34f7-47ee-9145-ec8e2238c642 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.769s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:07.445483 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:07.476932 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] volume_snapshot_create: create_info: {'snapshot_id': 'e3dd9e72-4d53-4e1d-ba88-4dfbd56f4de7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=97971) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 14 04:26:07.486297 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] snap xml: <domainsnapshot>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:   <disks>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:     <disk name="/dev/dm-5" snapshot="external" type="file">
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:       <source file="/dev/new_file"/>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:     <disk name="vda" snapshot="no"/>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:     <disk name="hda" snapshot="no"/>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:   </disks>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]: </domainsnapshot>
May 14 04:26:07.486297 np0000000747 nova-compute[97971]:  {{(pid=97971) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 14 04:26:07.486297 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] Lazy-loading 'system_metadata' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:07.515327 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29e395f8-f20b-4898-ac06-b7bcb14528a1 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] volume_snapshot_delete: delete_info: {'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2'} {{(pid=97971) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [None req-29e395f8-f20b-4898-ac06-b7bcb14528a1 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Traceback (most recent call last):
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     self._volume_snapshot_delete(context, instance, volume_id,
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     if delete_info['type'] != 'qcow2':
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]        ~~~~~~~~~~~^^^^^^^^
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] KeyError: 'type'
May 14 04:26:07.526635 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] 
May 14 04:26:07.578311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:07.579007 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [None req-29e395f8-f20b-4898-ac06-b7bcb14528a1 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-03d32b6b-8a45-4c1a-90ed-f91c2e2b0dd4)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 04:26:07.605774 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 14 04:26:07.606976 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server [None req-29e395f8-f20b-4898-ac06-b7bcb14528a1 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] Exception during message handling: KeyError: 'type'
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 14 04:26:07.623165 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server 
May 14 04:26:07.768227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:07.768227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:07.768227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:07.768227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:07.768227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:07.770199 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Terminating instance
May 14 04:26:07.989017 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Traceback (most recent call last):
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.000590 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] 
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Traceback (most recent call last):
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     self._volume_snapshot_create(context, instance, guest,
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.003691 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] 
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e3dd9e72-4d53-4e1d-ba88-4dfbd56f4de7 could not be found.
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e3dd9e72-4d53-4e1d-ba88-4dfbd56f4de7 could not be found. (HTTP 404) (Request-ID: req-70752067-b9b0-43be-a141-1db4d64d2815)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 14 04:26:08.030417 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e3dd9e72-4d53-4e1d-ba88-4dfbd56f4de7 could not be found.
May 14 04:26:08.031979 np0000000747 nova-compute[97971]: ERROR nova.virt.libvirt.driver 
May 14 04:26:08.035024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server [None req-8f85835a-5ccc-48c1-bd09-889b6df01c23 tempest-VolumesAssistedSnapshotsTest-884260781 tempest-VolumesAssistedSnapshotsTest-884260781-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     raise self.value
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 14 04:26:08.041646 np0000000747 nova-compute[97971]: ERROR oslo_messaging.rpc.server 
May 14 04:26:08.083006 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:08.273950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:26:08.304163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:08.304517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:08.306740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.313209 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.329488 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.337092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.365281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.365936 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:08.591357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.876s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:08.591878 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Migrating
May 14 04:26:08.591878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:08.591878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "compute-rpcapi-router" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:08.592710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.558s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:08.603280 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:08.606589 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Claim successful on node np0000000747
May 14 04:26:08.611654 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99969114800001 future=<Future at 0x743618287fe0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:08.611654 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999255262000133 future=<Future at 0x743618287fe0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:08.611654 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999071110000159 future=<Future at 0x743618287fe0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:08.611654 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Instance destroyed successfully.
May 14 04:26:08.612207 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lazy-loading 'resources' on Instance uuid 3d2065cf-55ce-4795-9b83-3cfb61c69b07 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:08.807297 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Detaching volume 23aec858-f8e8-4bf5-a361-a29c4d13a2d2
May 14 04:26:08.865573 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Attempting to driver detach volume 23aec858-f8e8-4bf5-a361-a29c4d13a2d2 from mountpoint /dev/vdb
May 14 04:26:08.870310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Found disk vdb by alias ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:26:08.871349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Found disk vdb by alias ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:26:08.871481 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Attempting to detach device vdb from instance 7c1d2411-c23f-4714-9642-993e0931cd44 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:26:08.871733 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] detach device xml: <disk type="block" device="disk">
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <alias name="ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2"/>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <serial>23aec858-f8e8-4bf5-a361-a29c4d13a2d2</serial>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:08.871733 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:26:08.877885 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Successfully detached device vdb from instance 7c1d2411-c23f-4714-9642-993e0931cd44 from the persistent domain config.
May 14 04:26:08.878004 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] (1/8): Attempting to detach device vdb with device alias ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 from instance 7c1d2411-c23f-4714-9642-993e0931cd44 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:26:08.878272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] detach device xml: <disk type="block" device="disk">
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <alias name="ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2"/>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <serial>23aec858-f8e8-4bf5-a361-a29c4d13a2d2</serial>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:08.878272 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:26:09.095659 np0000000747 nova-compute[97971]: INFO nova.compute.rpcapi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 14 04:26:09.096235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "compute-rpcapi-router" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:09.096507 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:26:09.116961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1575982223',display_name='tempest-AttachSCSIVolumeTestJSON-server-1575982223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachscsivolumetestjson-server-1575982223',id=4,image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQpeuiWXraQssFKTZVxyy78919K9by+0ldNA+L/lhsJdUjDZ2YD5ifZIU61IuLWZc31kqGnUdjI1Ebf3ai/Uek3MikhIR2nxvP7ukhA8hjCnCZJqmEKI18wrHUz13dbHg==',key_name='tempest-keypair-729998820',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:10Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8279e74b07d4298a1edd1e0e903e655',ramdisk_id='',reservation_id='r-0s8edpn2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2321a84f-3cd6-4e03-9366-cb8c8ade19eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1685092360',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1685092360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07db15ee9344fe48a33da6399cfe47c',uuid=3d2065cf-55ce-4795-9b83-3cfb61c69b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:09.117210 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converting VIF {"id": "eab89968-1a53-4a5e-9dcc-204401711164", "address": "fa:16:3e:3e:dd:d5", "network": {"id": "e25b9940-ee89-4e52-82f3-c74d0e97ac8e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-233385641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c8279e74b07d4298a1edd1e0e903e655", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab89968-1a", "ovs_interfaceid": "eab89968-1a53-4a5e-9dcc-204401711164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:09.117976 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:09.118654 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:09.123008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:09.123601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeab89968-1a, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:09.124785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:09.126153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:09.135157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:09.137268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d64b74da-ef24-4804-abe2-ddb85c895ddf) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:09.140377 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:09.140653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:09.143645 np0000000747 nova-compute[97971]: INFO os_vif [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:d5,bridge_name='br-int',has_traffic_filtering=True,id=eab89968-1a53-4a5e-9dcc-204401711164,network=Network(e25b9940-ee89-4e52-82f3-c74d0e97ac8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab89968-1a')
May 14 04:26:09.144373 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Deleting instance files /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07_del
May 14 04:26:09.145215 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Deletion of /opt/stack/data/nova/instances/3d2065cf-55ce-4795-9b83-3cfb61c69b07_del complete
May 14 04:26:09.466345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732769.4632983, 7c1d2411-c23f-4714-9642-993e0931cd44 => ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:26:09.466345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 for instance 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:26:09.467912 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Successfully detached device vdb from instance 7c1d2411-c23f-4714-9642-993e0931cd44 from the live domain config.
May 14 04:26:09.468838 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:26:09.469225 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:09.469467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:09.641522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:09.641522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:09.641522 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:09.653645 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 04:26:09.655822 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:26:09.655822 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:26:09.655822 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:26:09.655822 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:09.750042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:09.751258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:09.751536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:09.751834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:09.752002 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] No waiting events found dispatching network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:09.752217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0736b352-9f30-4775-adef-24aa0259b90c req-108f2453-6762-4264-be6e-fc8d9905fd42 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:09.823332 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:10.139515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:10.139742 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:10.143818 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:10.550604 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e32731a9-2c03-4003-8165-4f82e7a2c6c3 req-dc1decdf-71b0-47f4-9169-94e26a2e57e6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-deleted-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:10.550826 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-e32731a9-2c03-4003-8165-4f82e7a2c6c3 req-dc1decdf-71b0-47f4-9169-94e26a2e57e6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Neutron deleted interface eab89968-1a53-4a5e-9dcc-204401711164; detaching it from the instance and deleting it from the info cache
May 14 04:26:10.551018 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e32731a9-2c03-4003-8165-4f82e7a2c6c3 req-dc1decdf-71b0-47f4-9169-94e26a2e57e6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:10.620117 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:10.642512 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:10.722548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:10.829722 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:10.984819 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:11.063005 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e32731a9-2c03-4003-8165-4f82e7a2c6c3 req-dc1decdf-71b0-47f4-9169-94e26a2e57e6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Detach interface failed, port_id=eab89968-1a53-4a5e-9dcc-204401711164, reason: Instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:26:11.153821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.561s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:11.154165 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:26:11.332418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:11.486860 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Took 1.83 seconds to deallocate network for instance.
May 14 04:26:11.660894 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:26:11.661810 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:26:11.662159 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:11.662515 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:11.766936 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff9421eb3ab146768fbebce716282eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332cd017291346918295d9dfbf49fb0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:26:11.808677 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:11.808841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] Acquiring lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:11.808983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:11.809085 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:11.809194 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] No waiting events found dispatching network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:11.809329 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5c310aab-5ab8-4566-8f5b-231893363cbb req-0c3aa17f-6cc0-40f4-8c3b-bfc344eb03c6 service nova] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Received unexpected event network-vif-unplugged-eab89968-1a53-4a5e-9dcc-204401711164 for instance with vm_state deleted and task_state None.
May 14 04:26:11.946269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:12.098088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:12.098088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:12.161839 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:26:12.243813 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Successfully created port: a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:12.497038 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.027s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:12.497746 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:26:12.497746 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:12.528719 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '9')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:26:12.528719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '12')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:12.531641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2', '13')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:12.531641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436183387c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'): ({'sdi'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:26:12.531641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:26:12.531641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Flush multipath device 33000000050a4f080 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:26:12.568953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:12.600627 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] instance snapshotting
May 14 04:26:12.633520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:12.666119 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:26:12.669035 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:12.669240 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:12.693405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:26:12.693751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:26:12.695066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:26:12.707951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:26:12.708151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:26:12.719217 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Beginning live snapshot process
May 14 04:26:12.722313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.759201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.40.100,3260]
May 14 04:26:12.759201 np0000000747 nova-compute[97971]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.40.100,3260] successful.
May 14 04:26:12.759201 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.776534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.790006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.831858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.50.100,3260]
May 14 04:26:12.831858 np0000000747 nova-compute[97971]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-23aec858-f8e8-4bf5-a361-a29c4d13a2d2, portal: 192.168.50.100,3260] successful.
May 14 04:26:12.831858 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.847643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:12.848632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:12.848632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] <== disconnect_volume: return (3378ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:12.848632 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:26:12.849065 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Starting migrate_disk_and_power_off {{(pid=97971) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 04:26:12.873314 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:12.875916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:12.897784 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Successfully updated port: a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:12.904086 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:12.932295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:12.937787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:12.982454 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-changed-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:12.982832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Refreshing instance network info cache due to event network-changed-a6919014-5039-435e-9e18-756211126b65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:12.983308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] Acquiring lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:12.983481 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] Acquired lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:12.983640 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Refreshing network info cache for port a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:13.175927 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:13.188383 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999700756000038 future=<Future at 0x7436183b67b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:13.190215 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance destroyed successfully.
May 14 04:26:13.191573 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:04Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:13.191836 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:13.192446 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:13.192686 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:13.193372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:13.193548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5088963d-83, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:13.196551 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:13.199890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:13.199890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7b429e9-190d-4aa9-870d-66ffc295faa6) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:13.201601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:13.209179 np0000000747 nova-compute[97971]: INFO os_vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:26:13.210720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:26:13.211734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:13.211876 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:13.212471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:13.213103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:26:13.213245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:26:13.244312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:13.244312 np0000000747 nova-compute[97971]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:13.244312 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:13.244312 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:13.244312 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:13.245003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:13.245003 np0000000747 nova-compute[97971]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:13.245003 np0000000747 nova-compute[97971]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:13.245003 np0000000747 nova-compute[97971]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:13.245003 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:13.245234 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '9')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:26:13.245346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '8')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:13.246196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '9')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:13.246912 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184ce700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:26:13.247104 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:26:13.247287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flush multipath device 3300000000e5614a0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:26:13.281951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:13.362129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:13.400033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:13.408127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:26:13.408358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:26:13.409282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:26:13.427178 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:26:13.427469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:26:13.429692 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lazy-loading 'flavor' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:13.439404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.473322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:26:13.473322 np0000000747 nova-compute[97971]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:26:13.473322 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.489973 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:13.491464 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.505882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.544919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:26:13.544919 np0000000747 nova-compute[97971]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:26:13.544919 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.558173 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:13.560169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:13.560813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:13.561243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== disconnect_volume: return (349ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:13.561243 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:26:13.571650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.640778 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.644723 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.686793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.588s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:13.691224 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:26:13.695351 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:26:13.695680 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Creating image(s)
May 14 04:26:13.696175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:13.696409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:13.697671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:13.700063 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:13.706670 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:13.708392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.724815 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.728150 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:26:13.728150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.755912 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:13.785901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.077s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.789568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:13.789568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:13.789568 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:13.791653 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:13.792425 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.812984 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Deleted allocations for instance 3d2065cf-55ce-4795-9b83-3cfb61c69b07
May 14 04:26:13.820786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.826828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk.config /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.853812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk.config /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config" returned: 0 in 0.029s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.854429 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk.info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.872485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.873389 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:13.884328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "cp -r /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_resize/disk.info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" returned: 0 in 0.029s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.915445 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:13.916331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:13.916331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:13.916331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:13.916755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:13.916755 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state active and task_state resize_migrating.
May 14 04:26:13.916755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:13.916919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:13.917070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:13.917582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:13.917800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:13.917958 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-73b5afa1-904e-4f66-b67b-4c219cb5572f req-85aec169-e14d-4332-b848-e9755326f8fc service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state active and task_state resize_migrating.
May 14 04:26:13.925348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk 1073741824" returned: 0 in 0.052s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:13.928808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:13.928808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.019043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.022200 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:26:14.022200 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.090106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Cannot resize image /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Ensure instance console log exists: /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:14.092408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:14.262335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5f4beb8-bfd3-4ff2-9521-6204ebecb89c req-0314d2f9-d306-4285-b4d4-c56162aeecec service nova] Releasing lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:14.265749 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquired lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:14.266037 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:14.271091 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.353876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json -f qcow2" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.354422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.440700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json -f qcow2" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.441670 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:14.447019 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:14.448034 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e3a04dd-a11d-4846-9b88-116fcc21f518 tempest-VolumesAssistedSnapshotsTest-1432906497 tempest-VolumesAssistedSnapshotsTest-1432906497-project-admin] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:14.449470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.529297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.080s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.529973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236.delta 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:14.576416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236.delta 1073741824" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:14.576904 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 04:26:14.828057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2aca382-3231-41cf-9a72-cc3b141f9980 tempest-AttachSCSIVolumeTestJSON-1685092360 tempest-AttachSCSIVolumeTestJSON-1685092360-project-member] Lock "3d2065cf-55ce-4795-9b83-3cfb61c69b07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.060s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:14.843976 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:14.872793 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:26:15.047269 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.047607 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.047779 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.048754 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.048754 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.048754 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.048855 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.049093 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.049309 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:26:15.049489 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:26:15.065783 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:15.092766 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:15.093134 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:15.192783 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 binding to destination host np0000000747 is already ACTIVE {{(pid=97971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 04:26:15.220433 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Updating instance_info_cache with network_info: [{"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:15.377221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:26:15.379125 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 04:26:15.430180 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:26:15.430486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236.delta /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:15.555865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:15.556175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:15.556415 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:15.556639 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:26:15.708547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236.delta /opt/stack/data/nova/instances/snapshots/tmpb0584lj6/00e849d3af144aa6976232861289f236" returned: 0 in 0.278s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:15.715752 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Snapshot extracted, beginning image upload
May 14 04:26:15.720488 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:15.725636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Releasing lock "refresh_cache-83a58dfc-399d-409f-918b-4f95da4b27b0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:15.725636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance network_info: |[{"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:26:15.725636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Start _get_guest_xml network_info=[{"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:15.729721 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:15.731248 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-797250209', uuid='83a58dfc-399d-409f-918b-4f95da4b27b0'), owner=OwnerMeta(userid='ff9421eb3ab146768fbebce716282eb4', username='tempest-VolumesActionsTest-1928867020-project-member', projectid='332cd017291346918295d9dfbf49fb0a', projectname='tempest-VolumesActionsTest-1928867020'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732775.7308218) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:15.736549 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:15.736915 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:15.737691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:15.737955 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:15.741647 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:15.754634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797250209',display_name='tempest-VolumesActionsTest-instance-797250209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-797250209',id=9,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-845dvboh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:13Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=83a58dfc-399d-409f-918b-4f95da4b27b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:15.754634 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:15.754634 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:15.754634 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lazy-loading 'pci_devices' on Instance uuid 83a58dfc-399d-409f-918b-4f95da4b27b0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:15.964148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:15.964577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:15.964648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:15.964760 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:15.964925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:15.968085 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Terminating instance
May 14 04:26:16.204056 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:26:16.213994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:16.213994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:16.213994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:16.229808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:16.231746 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:16.257039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <uuid>83a58dfc-399d-409f-918b-4f95da4b27b0</uuid>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <name>instance-00000009</name>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesActionsTest-instance-797250209</nova:name>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:15</nova:creationTime>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:user uuid="ff9421eb3ab146768fbebce716282eb4">tempest-VolumesActionsTest-1928867020-project-member</nova:user>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:project uuid="332cd017291346918295d9dfbf49fb0a">tempest-VolumesActionsTest-1928867020</nova:project>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         <nova:port uuid="a6919014-5039-435e-9e18-756211126b65">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="serial">83a58dfc-399d-409f-918b-4f95da4b27b0</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="uuid">83a58dfc-399d-409f-918b-4f95da4b27b0</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.config"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:96:9a:7c"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <target dev="tapa6919014-50"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/console.log" append="off"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:16.257039 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:16.259851 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Preparing to wait for external event network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:16.259851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:16.259851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:16.259851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:16.259851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797250209',display_name='tempest-VolumesActionsTest-instance-797250209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-797250209',id=9,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-845dvboh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:13Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=83a58dfc-399d-409f-918b-4f95da4b27b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:16.260110 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:16.260110 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:16.260110 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:16.260848 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.261290 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:16.261711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:16.262502 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.262804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc8650f-fa5a-54f6-af3f-a77e280334db', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:16.265701 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.266946 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:16.270296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.270636 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6919014-50, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:16.271139 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6919014-50, col_values=(('qos', UUID('7fc07a2c-13ee-478c-89e3-400b0d20d8f3')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:16.271409 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6919014-50, col_values=(('external_ids', {'iface-id': 'a6919014-5039-435e-9e18-756211126b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:9a:7c', 'vm-uuid': '83a58dfc-399d-409f-918b-4f95da4b27b0'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:16.272381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.274104 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:16.281508 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.282762 np0000000747 nova-compute[97971]: INFO os_vif [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50')
May 14 04:26:16.472510 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:26:16.499411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.501062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.521964 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.525047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.554733 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.557335 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:16.589806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:16.699119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:16.703540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:16.707518 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:16.707518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:16.707518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:16.708028 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:16.720923 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] No waiting events found dispatching network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:16.721457 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888072c-2fcf-46f3-b502-f3bf5fa2cc29 req-614b63f4-7988-4eac-a67e-1914907aaaf2 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:16.745727 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:16.821955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:16.829721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:16.846645 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99778729600007 future=<Future at 0x7436184c0380 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:16.846645 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Instance destroyed successfully.
May 14 04:26:16.846923 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lazy-loading 'resources' on Instance uuid 7c1d2411-c23f-4714-9642-993e0931cd44 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:16.920149 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:16.920732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.006933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.013379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.103860 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.104743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.126440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:17.126857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:17.189738 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.190262 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:26:17.193155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.263118 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:17.274592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.275571 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.352095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1524007842',display_name='tempest-VolumesAssistedSnapshotsTest-server-1524007842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesassistedsnapshotstest-server-1524007842',id=5,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIatJyZLgUXBy7e87V7TAlRodK+NUEIt/GyhTZ3psgC7/qxlBBEevV2VskVWS6kbcD8EPeMR+jpl0+EB5OtiUIFp9u9FESzo6n31bI5WGv5FUHgjRxK/n6B+L/wYiR4Y2g==',key_name='tempest-keypair-289926181',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:16Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19cb9c493fed4ce588a9753d844b0f98',ramdisk_id='',reservation_id='r-jy0000h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-718717706',owner_user_name='tempest-VolumesAssistedSnapshotsTest-718717706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:25:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1156e930feac4ac08980d240f4d88656',uuid=7c1d2411-c23f-4714-9642-993e0931cd44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:17.352396 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converting VIF {"id": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "address": "fa:16:3e:5c:cb:a1", "network": {"id": "4f0f9f80-a84d-4282-93dc-2cc3d489c67c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2077297798-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "19cb9c493fed4ce588a9753d844b0f98", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ebe9d4-0b", "ovs_interfaceid": "e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:17.353518 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:17.353877 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:17.361032 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.361597 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7ebe9d4-0b, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:17.364469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.364469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:17.366852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.370547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.382968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.392544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:17.394360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:17.395735 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.395864 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81aecbcb-b562-4ada-a122-6206e4141fd5) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:17.397704 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.397795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:17.404955 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:17.405809 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Claim successful on node np0000000747
May 14 04:26:17.409069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:17.414120 np0000000747 nova-compute[97971]: INFO os_vif [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba,network=Network(4f0f9f80-a84d-4282-93dc-2cc3d489c67c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ebe9d4-0b')
May 14 04:26:17.414551 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Deleting instance files /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44_del
May 14 04:26:17.415336 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Deletion of /opt/stack/data/nova/instances/7c1d2411-c23f-4714-9642-993e0931cd44_del complete
May 14 04:26:17.440386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:17.440757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:17.441230 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:17.463168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.463855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.567874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.570241 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:17.571543 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:17.607812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.036s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:17.608493 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13398MB free_disk=74.51847076416016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:26:17.608673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:17.632183 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:17.815635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:17.815635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:17.815635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No VIF found with MAC fa:16:3e:96:9a:7c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:17.815635 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Using config drive
May 14 04:26:17.930646 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Took 1.46 seconds to destroy the instance on the hypervisor.
May 14 04:26:17.930646 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:26:17.930646 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:26:17.930646 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:26:17.930646 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:17.945596 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:18.084023 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:18.223172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:18.327318 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:18.532590 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:18.558953 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Creating config drive at /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.config
May 14 04:26:18.567941 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph5r0qfoa {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:18.628063 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph5r0qfoa" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:18.717586 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4705e78-07fa-4177-9f83-92ea1cd4d886 req-10ab29c2-b0cd-44e7-80da-f6897815639f service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-deleted-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:18.719055 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-f4705e78-07fa-4177-9f83-92ea1cd4d886 req-10ab29c2-b0cd-44e7-80da-f6897815639f service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Neutron deleted interface e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba; detaching it from the instance and deleting it from the info cache
May 14 04:26:18.720931 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f4705e78-07fa-4177-9f83-92ea1cd4d886 req-10ab29c2-b0cd-44e7-80da-f6897815639f service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:18.814191 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] Acquiring lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] Lock "7c1d2411-c23f-4714-9642-993e0931cd44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] No waiting events found dispatching network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:18.936750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49aab357-2c4e-4e35-820a-b3307764c805 req-dc2b4baf-566b-43b1-af22-d1daf4db6e14 service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Received event network-vif-unplugged-e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:19.080573 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:19.080963 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:19.159815 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:19.180932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.210051 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.231173 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4705e78-07fa-4177-9f83-92ea1cd4d886 req-10ab29c2-b0cd-44e7-80da-f6897815639f service nova] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Detach interface failed, port_id=e7ebe9d4-0b1c-4fe4-83f3-afa7608633ba, reason: Instance 7c1d2411-c23f-4714-9642-993e0931cd44 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:26:19.255576 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.317183 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:19.344781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.349274 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.363597 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Snapshot image upload complete
May 14 04:26:19.364547 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1fcbbcb3-1e23-4879-b1ae-d4d574fd3c4a tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Took 6.76 seconds to snapshot the instance on the hypervisor.
May 14 04:26:19.548666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.551163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.558028 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.558804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.578825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:19.585259 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:19.663125 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Took 1.73 seconds to deallocate network for instance.
May 14 04:26:19.841639 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:19.850457 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:19.873377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:19.910974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:19.911259 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:19.922365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:19.923476 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe96:9a7c', 'fe80::90dc:beff:fec4:cb9a'] 
May 14 04:26:19.923669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:19.923750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:19.924051 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:20.094648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.700s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:20.094648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:26:20.103472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.494s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:20.169415 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:20.174549 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732780.1741064, 83a58dfc-399d-409f-918b-4f95da4b27b0 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:20.174956 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] VM Started (Lifecycle Event)
May 14 04:26:20.601363 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:26:20.601549 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:26:20.601873 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:20.602128 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:20.678272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:20.683441 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732780.6831033, 83a58dfc-399d-409f-918b-4f95da4b27b0 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:20.683636 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] VM Paused (Lifecycle Event)
May 14 04:26:20.722122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:20.840279 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '880be5c4e79e4884bf63d220ef7cfd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93dd24bcdb5043d9b23426bea16778cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:26:21.093039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Starting finish_migration {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 04:26:21.094107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:26:21.094107 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Creating image(s)
May 14 04:26:21.094833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:21.110362 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:26:21.118678 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Applying migration context for instance 46c1f391-bb33-4215-9e23-0d7999c5fc87 as it has an incoming, in-progress migration 325dfb3b-1149-42ea-a1b7-8f00af21f013. Migration status is post-migrating {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 14 04:26:21.120632 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating resource usage from migration 325dfb3b-1149-42ea-a1b7-8f00af21f013
May 14 04:26:21.178511 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.178998 np0000000747 nova-compute[97971]: WARNING nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7c1d2411-c23f-4714-9642-993e0931cd44 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 14 04:26:21.178998 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.178998 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance eb9bb511-c615-4ea8-9fa3-c784c88a680d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.178998 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Migration 325dfb3b-1149-42ea-a1b7-8f00af21f013 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 04:26:21.179120 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 46c1f391-bb33-4215-9e23-0d7999c5fc87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.179120 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 83a58dfc-399d-409f-918b-4f95da4b27b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.179189 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4da473ba-6f29-4334-b061-1d1d34f65717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:26:21.180971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:21.181453 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:26:21.181703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:21.196255 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:21.204174 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:21.205349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:21.205683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:21.206086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:21.206853 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:21.209796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Processing event network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:26:21.209796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:21.210059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:21.210190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:21.212569 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:21.213359 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] No waiting events found dispatching network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:21.213844 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-54527d67-5d13-43d9-a80f-5b60153c6bf2 req-bb464c91-b758-4689-8894-110203df2b73 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received unexpected event network-vif-plugged-a6919014-5039-435e-9e18-756211126b65 for instance with vm_state building and task_state spawning.
May 14 04:26:21.216011 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:26:21.221825 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:26:21.225100 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance spawned successfully.
May 14 04:26:21.225631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:26:21.269235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:21.269719 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Cannot resize image /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:26:21.333723 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully created port: 0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:21.483957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:21.483957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:21.682602 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 04:26:21.683461 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:26:21.683889 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1920MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:26:17 up 26 min,  2 users,  load average: 6.11, 3.27, 1.57\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_c6680b6e8f4e4852b7d9bb1f67e84fe6': '2', 'io_workload': '2', 'num_task_resize_finish': '1', 'num_proj_f5ff321993c84c0d9681976a6cce4a8e': '1', 'num_proj_2d49cec32e7e4e59ab41cd04147db756': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_332cd017291346918295d9dfbf49fb0a': '1', 'num_proj_93dd24bcdb5043d9b23426bea16778cb': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:26:21.718263 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:21.724112 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732781.7184029, 83a58dfc-399d-409f-918b-4f95da4b27b0 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:21.725902 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] VM Resumed (Lifecycle Event)
May 14 04:26:21.734652 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.734855 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.735235 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.735566 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.735899 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.736206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:21.772240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:26:21.772240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Ensure instance console log exists: /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:21.772557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:21.772738 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:21.772852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:21.775744 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start _get_guest_xml network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cd0bdd2a-2cd5-43c7-bc41-d772ef8febd3', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '46c1f391-bb33-4215-9e23-0d7999c5fc87', 'attached_at': '2026-05-14T04:26:20.000000', 'detached_at': '', 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'serial': '37e1df64-4e5a-460c-9776-48fc8b73d1fe'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:21.781522 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:21.783127 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-438362794', uuid='46c1f391-bb33-4215-9e23-0d7999c5fc87'), owner=OwnerMeta(userid='5a9f12c806cf4682a13e57b5866d94df', username='tempest-ServerActionsTestOtherB-1774572299-project-member', projectid='f5ff321993c84c0d9681976a6cce4a8e', projectname='tempest-ServerActionsTestOtherB-1774572299'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732781.7827086) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:21.784394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:21.784738 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:21.785349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:21.785562 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:21.787367 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:21.787914 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:21.788136 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:21.788223 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:21.788418 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:21.788554 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:21.788714 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:21.788921 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:21.789101 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:21.789255 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:21.789419 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:21.789587 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:21.799915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:21.804153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:21.900079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:21.900671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:21.900991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:21.902092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:21.902630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:21.903098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:21.903308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:21.903769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:21.904009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:21.920579 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully created port: 94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:21.922848 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:21.923738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:21.924921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:21.926278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:21.926690 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:21.926991 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:21.945470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:21.945470 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:21.946142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:21.946142 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:21.961664 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:26:21.961664 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:21.961664 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:21.961664 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:21.961664 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:21.961664 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:21.961664 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:21.961979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:21.962161 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:21.962360 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:21.964836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:26:21.964836 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:21.964836 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:21.964836 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:21.964836 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:21.964836 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:21.964836 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:21.965153 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:21.965153 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:21.965432 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:21.988269 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'flavor' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:22.227528 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:22.228932 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:22.242603 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Took 8.55 seconds to spawn the instance on the hypervisor.
May 14 04:26:22.242943 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:22.325817 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully created port: 2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:22.335201 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:22.335721 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:22.397432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:22.621701 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:26:22.732190 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:22.751767 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Took 14.80 seconds to build instance.
May 14 04:26:22.809982 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully created port: 2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:22.840685 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:22.962850 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:22.965711 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:22.974775 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:22.974775 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:22.980723 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:22.980723 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:22.987809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:22.994504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:23.001440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:23.002154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:26:23.002154 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:23.002402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:26:23.002402 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:23.002572 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:26:23.002572 np0000000747 nova-compute[97971]: 
May 14 04:26:23.008033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:26:23.008033 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:23.008033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:26:23.008033 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:23.008033 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:26:23.008033 np0000000747 nova-compute[97971]: 
May 14 04:26:23.027490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:26:23.027490 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:26:23.027490 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:23.039571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:23.041026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:26:23.041026 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:26:23.041026 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:23.055031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.055031 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.055031 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:23.055341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.055341 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.055341 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:23.055497 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:23.055599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:23.056021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('7', '-', '-', 0) found on session 16 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:23.056129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:23.060697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.080975 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:23.080975 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('8', '-', '-', 0) found on session 17 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:23.080975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:23.084801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 16 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:23.084949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:23.095922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 17 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:23.095922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:23.127885 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Booting with volume 30c2f68f-3115-4040-9e7e-9f3f1d87fbbb at /dev/vda
May 14 04:26:23.183741 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:23.198245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:23.234370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:23.257792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e903271-582c-4b1c-b953-717d8efcf27c tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.316s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:23.274460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:23.275161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:23.285564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:23.287576 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe96:9a7c', 'fe80::90dc:beff:fec4:cb9a'] 
May 14 04:26:23.287576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:23.287576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:23.287576 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:23.287576 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating existing volume attachment record: e223c2c8-360d-40d6-9812-90487699dd3b {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:23.349126 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully created port: ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:23.352936 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:26:23.352936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:23.353100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.130s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:23.357057 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.26 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:26:23.360974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:23.361158 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Claim successful on node np0000000747
May 14 04:26:23.611264 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0011598219998631976 future=<Future at 0x743618287fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:23.611264 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:23.611264 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.574448845999996 future=<Future at 0x7436183b67b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:23.611264 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.574358950000033 future=<Future at 0x7436183b67b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:23.612052 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778732768.6095846, 3d2065cf-55ce-4795-9b83-3cfb61c69b07 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:23.612052 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] VM Stopped (Lifecycle Event)
May 14 04:26:23.930193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:23.977474 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:24.030208 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:24.030475 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-0b752b51-9720-4646-9cc2-bf7aa483b3a0. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:24.030737 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:24.031180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:24.031342 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:24.092867 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:24.093096 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:24.093349 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attaching volume 10879ea1-3e25-4c10-bbc1-b357964a9ce8 to /dev/vdb
May 14 04:26:24.115278 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1b8d0aa6-1d13-4ee3-87f7-fa4eecb7f56f None None] [instance: 3d2065cf-55ce-4795-9b83-3cfb61c69b07] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:24.147462 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:24.159722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:24.180931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:24.209194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:24.209747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:24.218484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:24.219965 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe96:9a7c', 'fe80::90dc:beff:fec4:cb9a'] 
May 14 04:26:24.220114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:24.220265 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:24.220547 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:24.220849 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating existing volume attachment record: 6edc9c98-0c5c-425d-865a-17c28b124a4a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:24.533521 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:24.630671 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:24.775634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:24.776023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:24.776192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:24.829330 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:24.909390 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Booting with volume 5a8a54d2-9207-45f3-9d16-8b73a48a5e21 at /dev/vdb
May 14 04:26:24.950175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Found WWN 3300000000e5614a0 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:24.950669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:24.950989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-0', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:24.950989 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-0', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:24.952099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:24.952394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:24.968339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:24.971203 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:24.973248 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:24.974663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:24.974663 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:24.975016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:24.975222 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:24.977200 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:24.977481 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:24.990844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:24.990844 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:24.998540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:24.999043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:24.999043 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:25.009581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8] added
May 14 04:26:25.009581 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:25.009581 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:25.009581 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:25.009581 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:25.009581 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:25.009581 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:25.009994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:25.010041 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:25.010669 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:25.017950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8] added
May 14 04:26:25.017950 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:25.017950 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:25.017950 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:25.017950 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:25.017950 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:25.017950 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:25.018135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:25.018265 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:25.018443 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:25.024951 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:25.050831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:25.051222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:25.060984 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:25.063540 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe96:9a7c', 'fe80::90dc:beff:fec4:cb9a'] 
May 14 04:26:25.064113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:25.064297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:25.064576 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:25.064820 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating existing volume attachment record: e9d652f3-b195-4ab6-aaae-4c6ecb570871 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:25.157286 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:25.217288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:25.217717 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-12868c4f-d9e7-4d6c-80bb-07382344b782. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:25.217927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:25.318751 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:25.318935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:25.319156 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:25.319950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:25.320089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:25.323107 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Terminating instance
May 14 04:26:25.334173 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c83d42f-cad0-4b2e-8c08-6f6e2c2bc472 req-f250af6e-d878-4447-baab-38e0d7d6e45a service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:25.335002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:25.335488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:25.457460 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:04Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:25.457772 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:25.458436 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:25.460547 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <uuid>46c1f391-bb33-4215-9e23-0d7999c5fc87</uuid>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <name>instance-00000003</name>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <memory>262144</memory>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherB-server-438362794</nova:name>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:21</nova:creationTime>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.micro" id="84">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:memory>256</nova:memory>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:user uuid="5a9f12c806cf4682a13e57b5866d94df">tempest-ServerActionsTestOtherB-1774572299-project-member</nova:user>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:project uuid="f5ff321993c84c0d9681976a6cce4a8e">tempest-ServerActionsTestOtherB-1774572299</nova:project>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         <nova:port uuid="5088963d-83e8-4f8a-afab-b4d7c1a9b5c5">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="serial">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="uuid">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <alias name="ua-37e1df64-4e5a-460c-9776-48fc8b73d1fe"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <serial>37e1df64-4e5a-460c-9776-48fc8b73d1fe</serial>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e5:d2:fb"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <target dev="tap5088963d-83"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/console.log" append="off"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:25.460547 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:25.462574 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:04Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:25.462574 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1052752648-network", "vif_mac": "fa:16:3e:e5:d2:fb"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:25.462736 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:25.462736 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:25.462986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.463446 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:25.463957 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:25.465207 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.465502 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb85651e-e26e-55d5-876b-4161a471977e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:25.466548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.467476 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:25.467948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.470311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.470528 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5088963d-83, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:25.470953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5088963d-83, col_values=(('qos', UUID('ed02cb0d-e079-4460-854e-6f6fdb22566f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:25.471177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5088963d-83, col_values=(('external_ids', {'iface-id': '5088963d-83e8-4f8a-afab-b4d7c1a9b5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:d2:fb', 'vm-uuid': '46c1f391-bb33-4215-9e23-0d7999c5fc87'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:25.472303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.474132 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:25.479122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.481339 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:25.487389 np0000000747 nova-compute[97971]: INFO os_vif [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:26:25.724023 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.830468 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:26:25.838960 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:25.854373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.858432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.876111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.879914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.912158 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.913587 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:25.928143 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:25.991891 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.639s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:25.992604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.823s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:25.992822 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:26:26.000024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.008s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:26.011738 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:26.020999 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:26.030881 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:26.030881 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:26.034336 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:26.034336 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.049688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.051202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.067170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.067170 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.067170 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:26.067170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.067170 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.067170 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:26.074593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.074593 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.074593 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:26.074954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.074954 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.074954 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:26.083697 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:26.084327 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:26.084649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:26.084864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:26.085301 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] No waiting events found dispatching network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:26.085381 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-079a48df-842f-4ab9-b50f-6983f559e8d6 req-458486f7-deb0-4ee5-af82-1153441103b6 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:26.104434 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:26.105956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.50.100,3260]
May 14 04:26:26.105956 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.50.100,3260] successful.
May 14 04:26:26.105956 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.111385 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Deleted allocations for instance 7c1d2411-c23f-4714-9642-993e0931cd44
May 14 04:26:26.121849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.122628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.40.100,3260]
May 14 04:26:26.122628 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.40.100,3260] successful.
May 14 04:26:26.122628 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.139414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.139414 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.139414 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.139414 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.139414 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:26.139670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.139670 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.139670 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.139670 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.139670 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:26.139826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:26.139896 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:26.140599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] HCTL ('9', '-', '-', 0) found on session 18 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:26.140599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:26.141300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:26.156222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.156222 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.156222 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.156222 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.156222 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:26.156451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.156451 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:26.156451 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.156451 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:26.156451 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:26.156602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:26.156710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:26.157300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] HCTL ('10', '-', '-', 0) found on session 19 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:26.157387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:26.167135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching for a device in session 18 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:26.167135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:26.179895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching for a device in session 19 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:26.200529 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999448249999887 future=<Future at 0x7436184c0440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:26.201522 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Instance destroyed successfully.
May 14 04:26:26.202906 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lazy-loading 'resources' on Instance uuid 83a58dfc-399d-409f-918b-4f95da4b27b0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:26.330608 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:26.502932 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:26:26.503089 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:26:26.503390 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:26.503568 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:26.566149 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:26:26.607405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ecd3e809-3f19-4c9f-8179-2616ca271da7 req-f55ff5a1-5328-4163-a88b-2cb3637c543d service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:26.706155 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-797250209',display_name='tempest-VolumesActionsTest-instance-797250209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-797250209',id=9,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-845dvboh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:22Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=83a58dfc-399d-409f-918b-4f95da4b27b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:26.706337 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "a6919014-5039-435e-9e18-756211126b65", "address": "fa:16:3e:96:9a:7c", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6919014-50", "ovs_interfaceid": "a6919014-5039-435e-9e18-756211126b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:26.706920 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:26.707120 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:26.708474 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.708984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6919014-50, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:26.709921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.710821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:26.713044 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Booting with volume 2e17f69b-e90f-4c84-a87e-091ca8b44aad at /dev/vdc
May 14 04:26:26.716650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.717574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.717681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fc07a2c-13ee-478c-89e3-400b0d20d8f3) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:26.718409 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.719146 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:26.724205 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:26.728628 np0000000747 nova-compute[97971]: INFO os_vif [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9a:7c,bridge_name='br-int',has_traffic_filtering=True,id=a6919014-5039-435e-9e18-756211126b65,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6919014-50')
May 14 04:26:26.728628 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Deleting instance files /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0_del
May 14 04:26:26.729568 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Deletion of /opt/stack/data/nova/instances/83a58dfc-399d-409f-918b-4f95da4b27b0_del complete
May 14 04:26:26.758453 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:26.771593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:26.791756 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:26.819989 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:26.820435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:26.829886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:26.831050 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988'] 
May 14 04:26:26.831225 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:26.831418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:26.831607 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:26.831945 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating existing volume attachment record: e1878a22-4262-436a-80e0-5c77b32ca8aa {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:27.005919 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:26:27.012088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:27.012231 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:27.012393 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:27.012535 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] No VIF found with MAC fa:16:3e:e5:d2:fb, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:27.013116 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Using config drive
May 14 04:26:27.017079 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Successfully created port: 4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:27.120479 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c69f3ea9-6d70-4b10-86ab-52a398403b53 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Lock "7c1d2411-c23f-4714-9642-993e0931cd44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:27.180092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching for a device in session 19 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:27.180264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:27.239317 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:26:27.240323 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:26:27.240703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:26:27.240819 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:26:27.241091 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:27.316261 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:27.316407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-5957b670-2b91-4059-9b2b-6ff7707d41d9. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:27.316882 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:27.317186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:27.317446 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:27.481498 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:27.495108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.510060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:26:27.526278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.549641 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:27.641257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.688285 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Successfully updated port: 4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:27.766215 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-changed-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:27.766601 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Refreshing instance network info cache due to event network-changed-4d32e0e9-b676-4d88-83ac-8db2cc16a609. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:27.767720 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] Acquiring lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:27.768407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] Acquired lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:27.768624 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Refreshing network info cache for port 4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:27.819572 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:27.837576 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.840375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.845120 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.872459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:27.998782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Found WWN 3300000002cc7dc72 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:27.999295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:27.999731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] <== connect_volume: return (3222ms) {'type': 'block', 'scsi_wwn': '3300000002cc7dc72', 'path': '/dev/dm-1', 'multipath_id': '3300000002cc7dc72'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:27.999933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cc7dc72', 'path': '/dev/dm-1', 'multipath_id': '3300000002cc7dc72'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:28.005944 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'flavor' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:28.025628 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Booting with volume 7f6aa122-73a4-4c06-9a6f-580b8117a0a7 at /dev/vda
May 14 04:26:28.032503 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:28.094786 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:28.111395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:28.147042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:28.180262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:28.186362 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005387549999795738 future=<Future at 0x7436183b67b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:28.186362 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:28.186520 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.655172508000078 future=<Future at 0x7436184c0380 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:28.188563 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.653911004000065 future=<Future at 0x7436184c0380 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:28.188563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:28.190674 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] Emitting event <LifecycleEvent: 1778732773.1855407, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:28.192339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:28.192556 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Stopped (Lifecycle Event)
May 14 04:26:28.203749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:28.204191 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fee5:d2fb', 'fe80::e47b:a2ff:fe54:552c'] 
May 14 04:26:28.204421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:28.204810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:28.204959 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:28.205213 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Updating existing volume attachment record: e2cc956b-44be-4c0b-9e78-fa578b97309b {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:28.209433 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:28.215252 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:28.216061 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Acquiring lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:28.216261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:28.216652 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:28.216652 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] No waiting events found dispatching network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:28.216917 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-unplugged-a6919014-5039-435e-9e18-756211126b65 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:28.217029 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:28.217431 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-94f74dab-b8f0-4b58-b8e9-f291299ec4c0. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:28.217431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:28.271235 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:28.512644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attempting to attach volume 10879ea1-3e25-4c10-bbc1-b357964a9ce8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:26:28.513632 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 46c1f391-bb33-4215-9e23-0d7999c5fc87 due to new event <LifecycleEvent: 1778732788.5131266, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:26:28.513709 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732788.5131266, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:28.515715 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Resumed (Lifecycle Event)
May 14 04:26:28.515715 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:26:28.519465 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:   <alias name="ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8"/>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:   <serial>10879ea1-3e25-4c10-bbc1-b357964a9ce8</serial>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:28.519465 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:26:28.530092 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance running successfully.
May 14 04:26:28.532023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Failed to set time: agent not configured {{(pid=97971) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 04:26:28.532296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7ee2328-d5b2-4761-bea0-4670fc559b45 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] finish_migration finished successfully. {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 04:26:28.590993 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:28.683097 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:28.695684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dac9bd34-8f1f-4f5c-9757-5a040d1a7649 tempest-VolumesAssistedSnapshotsTest-718717706 tempest-VolumesAssistedSnapshotsTest-718717706-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:28.772056 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:28.976268 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:26:28.978443 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:26:28.978961 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Creating image(s)
May 14 04:26:28.980178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:26:28.980178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Ensure instance console log exists: /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:28.981699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:28.981984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:28.982256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:29.023428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:29.026642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:29.094520 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Took 1.85 seconds to deallocate network for instance.
May 14 04:26:29.189999 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:29.411673 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:29.528243 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 04:26:29.528740 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732789.5285153, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:29.528977 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Started (Lifecycle Event)
May 14 04:26:29.610708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:29.610805 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:29.701433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59d3bcb6-5baa-476f-a9da-b0c99a0e35fe req-db70eaf3-b786-4e8e-95af-834c2ced75d2 service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:29.704000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:29.705432 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:29.878819 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:29.879151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:29.879198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:29.879353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:29.879814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:29.879947 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state resized and task_state None.
May 14 04:26:29.880048 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:29.880169 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:29.880357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:29.880490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:29.880637 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:29.880794 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state resized and task_state None.
May 14 04:26:29.880931 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Received event network-vif-deleted-a6919014-5039-435e-9e18-756211126b65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:29.881041 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:29.881126 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-2103083d-c391-40bf-8a73-79aea110acb4. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:29.881239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:29.915728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f788dffb-e3bd-4fc5-803b-7a14a31b18b4 req-92fd977d-9a9c-4fdb-abb8-f0d4362ce2b1 service nova] Releasing lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:29.917485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:29.919822 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:30.033107 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:30.041153 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:30.070356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:30.174007 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:30.174279 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:30.206809 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:30.209381 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:30.209532 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:30.209598 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:30.209730 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No VIF found with MAC fa:16:3e:40:ab:68, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:30.352218 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:26:30.353310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:26:30.353555 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Creating image(s)
May 14 04:26:30.354026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:26:30.354162 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Ensure instance console log exists: /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:30.354316 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:30.354503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:30.355117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:30.448475 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: 2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:30.510638 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:30.658071 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:30.676962 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:30.727184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:30.801535 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:30.802517 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-2bdfb3b0-76cc-4c8f-8737-04b5c6682806. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:30.802771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:30.840060 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:30.963387 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.186655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.575s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:31.272983 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Deleted allocations for instance 83a58dfc-399d-409f-918b-4f95da4b27b0
May 14 04:26:31.316054 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:31.343358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6da95f87-ac49-450d-992c-99bc3501d746 req-c216dac8-ec16-4e7f-977b-0099114672c9 service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:31.343751 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:31.343945 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:31.457225 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.562282 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Successfully updated port: ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:31.618468 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Updating instance_info_cache with network_info: [{"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:31.621837 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.621837 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.622045 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.637891 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:31.638037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-ce562d2b-9682-4f0d-a82a-4061d061deec. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:31.638202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:31.694039 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Port 5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 binding to destination host np0000000747 is already ACTIVE {{(pid=97971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 04:26:31.694114 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:31.694170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:31.694251 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:31.720375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:31.803849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-174b4040-9e79-405a-9918-7c75e597b78f tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.711s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:31.842223 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005424399998901208 future=<Future at 0x7436184c0380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:31.842359 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:31.842359 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.357488354999987 future=<Future at 0x7436184c0440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:31.842465 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.357397847999891 future=<Future at 0x7436184c0440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:31.842730 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1b8d0aa6-1d13-4ee3-87f7-fa4eecb7f56f None None] Emitting event <LifecycleEvent: 1778732776.8414814, 7c1d2411-c23f-4714-9642-993e0931cd44 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:31.842878 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1b8d0aa6-1d13-4ee3-87f7-fa4eecb7f56f None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] VM Stopped (Lifecycle Event)
May 14 04:26:31.846295 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:31.959056 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:32.065065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:32.125012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-7000f23a-3a6a-40b1-8346-74d4b436e56a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:32.125481 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance network_info: |[{"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:26:32.126193 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Start _get_guest_xml network_info=[{"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e2cc956b-44be-4c0b-9e78-fa578b97309b', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7000f23a-3a6a-40b1-8346-74d4b436e56a', 'attached_at': '', 'detached_at': '', 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'serial': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:32.128389 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:32.129910 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-866503317', uuid='7000f23a-3a6a-40b1-8346-74d4b436e56a'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732792.1294348) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:32.130957 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:32.131333 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:32.132304 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:32.132304 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:32.133177 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:32.133437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:32.133544 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:32.133666 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:32.134987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:32.159594 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:32.160055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:32.161023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:32.161023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:32.161023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:32.169455 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:32.180861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:32.184584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:32.184584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:32.184584 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:32.184584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:32.184584 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:32.195637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:32.195637 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:32.196893 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:32.203340 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:32.203340 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:32.211342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7] added
May 14 04:26:32.211342 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:32.211342 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:32.211342 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:32.211342 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:32.211342 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:32.211342 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:32.211679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:32.212414 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:32.212414 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:32.213950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7] added
May 14 04:26:32.213950 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:32.213950 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:32.213950 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:32.213950 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:32.213950 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:32.213950 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:32.214195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:32.214236 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:32.214349 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:32.230012 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Rescuing
May 14 04:26:32.230012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:32.230012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:32.230012 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:32.282884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f4810d-2fbf-4b2a-a03c-075a217b3cb0 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "83a58dfc-399d-409f-918b-4f95da4b27b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.964s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:32.304058 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:32.351273 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1b8d0aa6-1d13-4ee3-87f7-fa4eecb7f56f None None] [instance: 7c1d2411-c23f-4714-9642-993e0931cd44] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:32.612286 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:32.673325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ac911bdf-d8ab-471f-ba27-56f87ce2d76e req-effc3103-fdcc-4ea1-ab58-38daac15618d service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:32.674125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:32.674125 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:32.734360 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:32.778712 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:33.176610 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:33.212526 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:33.219063 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:33.227494 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:33.227494 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:33.234675 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:33.234675 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.247321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.260220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.274647 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:33.282233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:33.285151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.285151 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.285151 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.285151 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.285151 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:33.285465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.285465 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.285465 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.285465 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.285465 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:33.323845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.40.100,3260]
May 14 04:26:33.323845 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.40.100,3260] successful.
May 14 04:26:33.323845 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.338956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.345736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.50.100,3260]
May 14 04:26:33.345736 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.50.100,3260] successful.
May 14 04:26:33.345736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.356779 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.357252 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:33.357433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:33.357605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:33.358401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('11', '-', '-', 0) found on session 20 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:33.358546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:33.364272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.387276 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:33.387483 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:33.387764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:33.387901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:33.388216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 20 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:33.388358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:33.389415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('12', '-', '-', 0) found on session 21 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:33.389541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:33.395146 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:33.403101 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:33.418257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 21 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:33.418257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:33.624450 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:33.671689 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:33.673834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:33.674040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:33.789503 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Creating tmpfile /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/tmp5_3e7hut to verify with other compute node that the instance is on the same shared storage. {{(pid=97971) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 14 04:26:33.789722 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:26:34.128953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e96c8114-2573-43b4-afaa-bdb4780a9679 req-318ed5fe-d9ea-43d2-833e-b376400d3cc9 service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:34.129133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:34.129283 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:34.177469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:34.182685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:34.186683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:34.314013 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.336968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.343900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.359556 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.367014 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.508917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:34.630405 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999648599000011 future=<Future at 0x74361bf54740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:34.632652 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance destroyed successfully.
May 14 04:26:34.633930 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'resources' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:34.637071 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:34.752549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:34.752846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:34.757071 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:34.757284 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Claim successful on node np0000000747
May 14 04:26:34.872540 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:35.029754 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:35.137989 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:29Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:35.138368 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:35.138913 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:35.139264 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:35.141907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.142237 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5088963d-83, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:35.143587 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.144432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:35.145263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.145597 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.145797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed02cb0d-e079-4460-854e-6f6fdb22566f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:35.146386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.147140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:35.147563 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.150283 np0000000747 nova-compute[97971]: INFO os_vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:26:35.151336 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:26:35.151779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:35.151983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:35.201871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 330000000f221aac0 for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:35.202379 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:35.202651 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000f221aac0', 'path': '/dev/dm-2', 'multipath_id': '330000000f221aac0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:35.203371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f221aac0', 'path': '/dev/dm-2', 'multipath_id': '330000000f221aac0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:35.203492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.051s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:35.204048 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:26:35.204460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:35.232452 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:35.232704 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:35.232830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:26:35.232981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '16')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:35.234083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '17')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:26:35.239290 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bf95d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:26:35.239415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:26:35.239995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flush multipath device 3300000000e5614a0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:26:35.274944 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:35.327606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:26:35.398096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:26:35.398302 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:26:35.402971 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:26:35.418851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:26:35.419329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:26:35.441386 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.464944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.483799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:26:35.483799 np0000000747 nova-compute[97971]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:26:35.483799 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.500726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.514182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.532755 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-788fff9f-79c2-48c4-879b-057d022c86bb req-4adfe925-79a1-42a9-ac22-52d1e30ab2ea service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:35.534503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:35.534503 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:35.546745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:26:35.546745 np0000000747 nova-compute[97971]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:26:35.546745 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.564466 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:35.565032 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:35.565244 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== disconnect_volume: return (413ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:35.565244 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:26:35.576062 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:26:35.709639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-866503317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-866503317',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-7gck1zu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:28Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=7000f23a-3a6a-40b1-8346-74d4b436e56a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:35.709639 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:35.710177 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:35.711011 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid 7000f23a-3a6a-40b1-8346-74d4b436e56a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:35.728527 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.822899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.827381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.844552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.853952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:35.888407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.165576 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:36.173224 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999709001000156 future=<Future at 0x7436186b47a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:36.175510 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance destroyed successfully.
May 14 04:26:36.175510 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'numa_topology' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:36.214806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <uuid>7000f23a-3a6a-40b1-8346-74d4b436e56a</uuid>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <name>instance-0000000b</name>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-866503317</nova:name>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:32</nova:creationTime>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         <nova:port uuid="4d32e0e9-b676-4d88-83ac-8db2cc16a609">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="serial">7000f23a-3a6a-40b1-8346-74d4b436e56a</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="uuid">7000f23a-3a6a-40b1-8346-74d4b436e56a</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/disk.config"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <alias name="ua-7f6aa122-73a4-4c06-9a6f-580b8117a0a7"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-2"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <serial>7f6aa122-73a4-4c06-9a6f-580b8117a0a7</serial>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <shareable/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ac:2f:49"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <target dev="tap4d32e0e9-b6"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/console.log" append="off"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:36.214806 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:36.219082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Preparing to wait for external event network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:36.219082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:36.219082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:36.219082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:36.219082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-866503317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-866503317',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-7gck1zu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:28Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=7000f23a-3a6a-40b1-8346-74d4b436e56a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:36.219440 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:36.219440 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:36.219440 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:36.223548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.224215 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:36.224781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:36.225569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.225742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72a20d57-4e4a-5b84-8177-11c9c370b809', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:36.227478 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.228897 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:36.234354 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.237879 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.238050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d32e0e9-b6, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:36.238465 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d32e0e9-b6, col_values=(('qos', UUID('919a559b-77b7-4985-ac99-63ee174a1d2b')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:36.238610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d32e0e9-b6, col_values=(('external_ids', {'iface-id': '4d32e0e9-b676-4d88-83ac-8db2cc16a609', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:2f:49', 'vm-uuid': '7000f23a-3a6a-40b1-8346-74d4b436e56a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:36.239855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.240966 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:36.254049 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:36.255374 np0000000747 nova-compute[97971]: INFO os_vif [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6')
May 14 04:26:36.340174 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:36.340514 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:36.472422 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:36.569644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:36.570224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:36.570369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:36.570475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:36.570609 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:36.570750 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9a70650f-a55c-43ef-8627-41a042396224 req-48d628ed-7079-480c-972f-5c430c5c0a93 service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state resized and task_state resize_reverting.
May 14 04:26:36.682356 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attempting a stable device rescue
May 14 04:26:36.735270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:36.818501 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:26:36.821818 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:26:36.821877 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Creating image(s)
May 14 04:26:36.825437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:36.825437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:36.825437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:36.825437 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:36.844468 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:36.897162 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:37.235937 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:37.324997 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:37.325232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:37.325548 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:37.354642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.599s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:37.354642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:26:37.354642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.619s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:37.598058 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:37.783700 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:37.783843 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:37.783934 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:ac:2f:49, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:37.784322 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Using config drive
May 14 04:26:37.822026 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:37.822258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:37.823260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:37.826824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:37.827009 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:37.827154 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7c27d36a-be54-4fde-aaa8-4bd99e2daa58 req-37ef2338-134f-4f5b-b980-eccabdce4ea7 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state rescuing.
May 14 04:26:37.860974 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'migration_context' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:37.872259 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:26:37.872782 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:26:37.872876 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:37.873110 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:38.065352 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:38.096180 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff9421eb3ab146768fbebce716282eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332cd017291346918295d9dfbf49fb0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:26:38.292982 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:38.372543 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:26:38.378079 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Object Instance<46c1f391-bb33-4215-9e23-0d7999c5fc87> lazy-loaded attributes: resources,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:38.545662 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Creating config drive at /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/disk.config
May 14 04:26:38.549918 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34blsq65 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:38.595826 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34blsq65" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:38.658460 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Successfully created port: e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:38.668364 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:38.693585 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:38.696897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:38.697160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:38.697303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:38.697673 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:38.697903 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fde75c19-aa79-4a51-a778-d9dcfe588803 req-53f1f537-4492-464f-9534-59131e89cf7e service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state resized and task_state resize_reverting.
May 14 04:26:38.723648 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:38.726482 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:38.726482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:38.809029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.part --force-share --output=json" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:38.810450 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] 480bc5bd-f14f-4673-a780-3062aa0847a0 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:26:38.810450 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:26:38.810562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.part /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:38.882114 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:26:38.978048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.010324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.part /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.converted" returned: 0 in 0.200s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:39.014566 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:39.014807 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:39.022033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:39.112967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:39.114013 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.788s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:39.114564 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.120243 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.122096 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:39.122770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:39.123017 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.127112 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.128497 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:39.164804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.203705 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.234892 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8 --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:39.235872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8,backing_fmt=raw /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:39.292007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.298388 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b56698fd4c94d911f892d25abcc151ee8f027fb8,backing_fmt=raw /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.rescue" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:39.301365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b56698fd4c94d911f892d25abcc151ee8f027fb8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:39.301636 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'migration_context' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:39.376010 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Successfully updated port: e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:39.506796 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.515211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.519590 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:39.542572 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.551650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:39.806843 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:39.807120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:26:39.809687 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start _get_guest_xml network_info=[{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "vif_mac": "fa:16:3e:40:ab:68"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '480bc5bd-f14f-4673-a780-3062aa0847a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6edc9c98-0c5c-425d-865a-17c28b124a4a', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57', 'attached_at': '', 'detached_at': '', 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'serial': '10879ea1-3e25-4c10-bbc1-b357964a9ce8'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:39.809687 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'resources' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:39.878709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:39.878709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquired lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:39.878899 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:39.895434 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:26:39.896961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:26:39.897360 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Creating image(s)
May 14 04:26:39.897992 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:39.898231 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:39.898823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:39.900158 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.903129 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.905427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:39.922641 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:39.930874 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:39.932111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:39.932367 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:39.932773 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:39.932919 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:39.933087 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d6ac5aba-796d-43d8-a0cd-4e7040b4a355 req-268776c3-841d-4e03-a3fb-bb594bd81ed3 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state rescuing.
May 14 04:26:39.993929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:39.994358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:39.994699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:39.995120 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.997686 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:39.998340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:40.057798 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:40.098142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:40.098142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:40.108282 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732800.1069067, 7000f23a-3a6a-40b1-8346-74d4b436e56a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:40.110233 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] VM Started (Lifecycle Event)
May 14 04:26:40.133120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk 1073741824" returned: 0 in 0.036s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:40.133762 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:40.135015 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:40.213894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:40.214427 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:26:40.215480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:40.297814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:40.300541 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Cannot resize image /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:26:40.301394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:26:40.301574 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Ensure instance console log exists: /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:40.301897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:40.302123 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:40.302244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:40.313099 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:40.315629 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:40.317123 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-745630866', uuid='b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57'), owner=OwnerMeta(userid='5d5b93fa488e469cab3d35f0d0283061', username='tempest-ServerStableDeviceRescueTest-933200266-project-member', projectid='2d49cec32e7e4e59ab41cd04147db756', projectname='tempest-ServerStableDeviceRescueTest-933200266'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "vif_mac": "fa:16:3e:40:ab:68"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732800.3167076) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:40.319688 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:40.321100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:40.322008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:40.322260 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:40.323320 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:40.323694 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:40.323828 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:40.323921 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:40.324026 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:40.324150 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:40.324278 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:40.324438 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:40.324538 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:40.324673 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:40.324769 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:40.324880 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:40.325022 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:40.468128 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:40.543653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.189s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:40.543960 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:26:40.560988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:40.560988 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance network_info: |[{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:26:40.562159 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Start _get_guest_xml network_info=[{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e223c2c8-360d-40d6-9812-90487699dd3b', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4da473ba-6f29-4334-b061-1d1d34f65717', 'attached_at': '', 'detached_at': '', 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'serial': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'}, 'volume_type': None}, {'attachment_id': 'e9d652f3-b195-4ab6-aaae-4c6ecb570871', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4da473ba-6f29-4334-b061-1d1d34f65717', 'attached_at': '', 'detached_at': '', 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'serial': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21'}, 'volume_type': None}, {'attachment_id': 'e1878a22-4262-436a-80e0-5c77b32ca8aa', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4da473ba-6f29-4334-b061-1d1d34f65717', 'attached_at': '', 'detached_at': '', 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'serial': '2e17f69b-e90f-4c84-a87e-091ca8b44aad'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:40.564892 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:40.566170 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1697871458', uuid='4da473ba-6f29-4334-b061-1d1d34f65717'), owner=OwnerMeta(userid='880be5c4e79e4884bf63d220ef7cfd04', username='tempest-TaggedBootDevicesTest-986832132-project-member', projectid='93dd24bcdb5043d9b23426bea16778cb', projectname='tempest-TaggedBootDevicesTest-986832132'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732800.5656855) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:40.567574 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:40.567806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:40.568469 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:40.568670 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:40.569528 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:40.569886 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:40.570048 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:40.570164 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:40.570278 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:40.570373 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:40.570758 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:40.570912 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:40.571038 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:40.571369 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:40.571509 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:40.571811 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:40.582880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:40.583023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:40.583202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:40.583494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:40.583687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:40.595978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:40.596712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:40.597743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:40.598250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:40.598514 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:40.598813 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:40.610214 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:40.610214 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:40.614335 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:40.615909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:40.615909 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:40.616540 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732800.6162665, 7000f23a-3a6a-40b1-8346-74d4b436e56a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:40.616677 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] VM Paused (Lifecycle Event)
May 14 04:26:40.623006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb] added
May 14 04:26:40.623006 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:40.623006 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:40.623006 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:40.623006 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:40.623006 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:40.623006 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:40.623375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:40.624193 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:40.624422 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:40.631673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb] added
May 14 04:26:40.631673 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:40.631673 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:40.631673 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:40.631673 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:40.631673 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:40.631673 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:40.631958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:40.632213 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:40.632424 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:40.642993 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:40.730900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:40.779103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-changed-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:40.779993 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Refreshing instance network info cache due to event network-changed-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:40.780493 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] Acquiring lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:40.809808 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Updating instance_info_cache with network_info: [{"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:40.827452 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:40.842532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:40.945951 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:40.946706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:40.949269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:40.949269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:40.949269 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:40.949269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:40.949269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:41.120010 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:41.122556 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:41.200423 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.000515211999982057 future=<Future at 0x7436184c0440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:41.200547 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:41.201027 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.429317512999887 future=<Future at 0x74361bf54740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:41.201027 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.429224068999929 future=<Future at 0x74361bf54740 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:41.201027 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778732786.1997886, 83a58dfc-399d-409f-918b-4f95da4b27b0 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:41.201166 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] VM Stopped (Lifecycle Event)
May 14 04:26:41.241509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.276138 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:41.276376 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:41.311845 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Releasing lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:41.312330 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Instance network_info: |[{"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:26:41.312801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] Acquired lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:41.313044 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Refreshing network info cache for port e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:41.316191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Start _get_guest_xml network_info=[{"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:41.320319 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:41.322072 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-289762294', uuid='370e3cd7-4f2f-44c5-97d6-d314825a560a'), owner=OwnerMeta(userid='ff9421eb3ab146768fbebce716282eb4', username='tempest-VolumesActionsTest-1928867020-project-member', projectid='332cd017291346918295d9dfbf49fb0a', projectname='tempest-VolumesActionsTest-1928867020'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732801.3215992) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:41.323789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:41.324475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:41.325426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:41.325661 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:41.328298 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:41.329972 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:41.330740 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:41.330940 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:41.331175 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:41.331369 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:41.331547 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:41.331764 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:41.332005 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:41.332185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:41.332388 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:41.332668 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:41.353142 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-289762294',display_name='tempest-VolumesActionsTest-instance-289762294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-289762294',id=12,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-k99vf0sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:39Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=370e3cd7-4f2f-44c5-97d6-d314825a560a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:41.353390 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:41.354690 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:41.355526 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lazy-loading 'pci_devices' on Instance uuid 370e3cd7-4f2f-44c5-97d6-d314825a560a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:41.625255 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:41.631463 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:41.638351 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:41.644740 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:41.644740 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:41.658751 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:41.658751 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.665601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.673446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.684018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.684018 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.684018 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.684018 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.684018 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:41.684252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.684252 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.684252 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.684252 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.684252 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:41.689428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.689428 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.689428 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.689428 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.689428 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:41.689598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.689598 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.689598 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.689598 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.689598 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:41.711861 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d081d5dc-4e73-49a2-b887-a600c343129b None None] [instance: 83a58dfc-399d-409f-918b-4f95da4b27b0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:41.711861 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.725011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.40.100,3260]
May 14 04:26:41.725011 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.40.100,3260] successful.
May 14 04:26:41.725011 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.738787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.745727 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.50.100,3260]
May 14 04:26:41.745727 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.50.100,3260] successful.
May 14 04:26:41.745727 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.753814 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.754142 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:41.754395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:41.754565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:41.756024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('7', '-', '-', 0) found on session 22 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:41.756024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:41.756714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.771658 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:41.771915 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:41.772442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:41.772442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:41.778667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('8', '-', '-', 0) found on session 23 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:41.778667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:41.778667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 22 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:41.778667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:41.782897 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'flavor' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:41.791715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 23 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:41.791886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:41.819413 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:41.858759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <uuid>370e3cd7-4f2f-44c5-97d6-d314825a560a</uuid>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <name>instance-0000000c</name>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesActionsTest-instance-289762294</nova:name>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:41</nova:creationTime>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:user uuid="ff9421eb3ab146768fbebce716282eb4">tempest-VolumesActionsTest-1928867020-project-member</nova:user>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:project uuid="332cd017291346918295d9dfbf49fb0a">tempest-VolumesActionsTest-1928867020</nova:project>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         <nova:port uuid="e59ccca7-4f67-49b2-aed6-cc420e1d3a7e">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="serial">370e3cd7-4f2f-44c5-97d6-d314825a560a</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="uuid">370e3cd7-4f2f-44c5-97d6-d314825a560a</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.config"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1a:04:cd"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <target dev="tape59ccca7-4f"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/console.log" append="off"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:41.858759 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Preparing to wait for external event network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-289762294',display_name='tempest-VolumesActionsTest-instance-289762294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-289762294',id=12,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-k99vf0sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:39Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=370e3cd7-4f2f-44c5-97d6-d314825a560a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.862198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:41.862656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:41.863275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.863501 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '265b6519-9f59-5f50-b325-cf00623a6981', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:41.868788 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.871362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:41.878381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.884176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.884176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape59ccca7-4f, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:41.884176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape59ccca7-4f, col_values=(('qos', UUID('5fc6094c-1557-439a-aa23-71969c06dc31')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:41.884176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape59ccca7-4f, col_values=(('external_ids', {'iface-id': 'e59ccca7-4f67-49b2-aed6-cc420e1d3a7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:04:cd', 'vm-uuid': '370e3cd7-4f2f-44c5-97d6-d314825a560a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:41.884842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.886397 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:41.904810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:41.906175 np0000000747 nova-compute[97971]: INFO os_vif [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f')
May 14 04:26:42.138087 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Swapping old allocation on dict_keys(['31f323e6-64de-412b-a8c9-20c9194ab897']) held by migration 325dfb3b-1149-42ea-a1b7-8f00af21f013 for instance
May 14 04:26:42.265260 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Overwriting current allocation {'allocations': {'31f323e6-64de-412b-a8c9-20c9194ab897': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}, 'generation': 16}}, 'project_id': 'f5ff321993c84c0d9681976a6cce4a8e', 'user_id': '5a9f12c806cf4682a13e57b5866d94df', 'consumer_generation': 1} on consumer 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 14 04:26:42.358414 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:42.524179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:42.524276 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquired lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:42.524450 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:42.579697 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:42.599325 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:42.760524 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Updated VIF entry in instance network info cache for port e59ccca7-4f67-49b2-aed6-cc420e1d3a7e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:26:42.760524 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Updating instance_info_cache with network_info: [{"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:42.791078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:43.027155 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:43.261312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66d33ca6-79c4-4ba7-a68c-a41c1c242c26 req-190607d4-ad5f-40ce-80f2-507261df3f8c service nova] Releasing lock "refresh_cache-370e3cd7-4f2f-44c5-97d6-d314825a560a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:43.366747 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:43.432771 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:43.432912 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:43.433043 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] No VIF found with MAC fa:16:3e:1a:04:cd, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:43.433590 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Using config drive
May 14 04:26:43.511877 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:43.618346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Found WWN 330000000102c8030 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:43.619327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:43.619327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000102c8030', 'path': '/dev/dm-0', 'multipath_id': '330000000102c8030'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:43.620432 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000102c8030', 'path': '/dev/dm-0', 'multipath_id': '330000000102c8030'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:43.620432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.671s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:43.620432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:43.639376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:43.639784 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:43.640785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:43.641204 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:43.641689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:43.641995 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:43.654663 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:43.654663 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:43.662333 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:43.662333 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:43.673244 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:43.673763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.692242 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.692446 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:43.692724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:43.693109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:43.693491 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] HCTL ('10', '0', '0', 0) found on session 19 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:43.693566 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.698928 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:43.699152 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:43.699365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:43.699494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:43.700089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] HCTL ('9', '0', '0', 0) found on session 18 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:43.700205 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:43.703020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:43.707861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching for a device in session 19 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:43.708158 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:43.713699 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Searching for a device in session 18 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:43.713853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:43.880294 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:43.880490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:43.880757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attaching volume c040e303-a25c-41fa-bebc-296f7d894996 to /dev/vdb
May 14 04:26:43.932643 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:43.939967 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:43.946925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:43.969704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:43.999078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:44.001447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:44.009442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:44.010837 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202'] 
May 14 04:26:44.011024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:44.011182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:44.011474 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:44.011780 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating existing volume attachment record: 7536a1c9-9182-4ae1-ad59-c80f4b1a4f23 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:26:44.015824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Releasing lock "refresh_cache-46c1f391-bb33-4215-9e23-0d7999c5fc87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:44.016577 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:44.029512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:26:44.051453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:44.081016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:26:44.081299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:26:44.091574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:26:44.093361 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202'] 
May 14 04:26:44.093494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:26:44.093710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:26:44.094066 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:44.109165 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Creating config drive at /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.config
May 14 04:26:44.116457 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_ypn3eko {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:44.130653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:44.131494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:44.131825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:44.160763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_ypn3eko" returned: 0 in 0.045s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:44.576309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:44.576781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:44.576781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:44.606636 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.640035 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.641835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.648397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:44.732656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.946177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.952924 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.957932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.987820 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:44.994841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:45.014494 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:45.014840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:45.015111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:45.015324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:45.015518 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] No event matching network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e in dict_keys([('network-vif-plugged', 'e59ccca7-4f67-49b2-aed6-cc420e1d3a7e')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:26:45.015679 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-86bcbf9f-b701-4c55-ad86-56f73325c487 req-f9854099-fae7-442a-a604-16035f84055f service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received unexpected event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e for instance with vm_state building and task_state spawning.
May 14 04:26:45.230563 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Starting finish_revert_migration {{(pid=97971) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 14 04:26:45.243360 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start _get_guest_xml network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b000656e-0157-4980-8624-1010009015dd', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '46c1f391-bb33-4215-9e23-0d7999c5fc87', 'attached_at': '2026-05-14T04:26:44.000000', 'detached_at': '', 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'serial': '37e1df64-4e5a-460c-9776-48fc8b73d1fe'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:26:45.246539 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:26:45.246731 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-438362794', uuid='46c1f391-bb33-4215-9e23-0d7999c5fc87'), owner=OwnerMeta(userid='5a9f12c806cf4682a13e57b5866d94df', username='tempest-ServerActionsTestOtherB-1774572299-project-member', projectid='f5ff321993c84c0d9681976a6cce4a8e', projectname='tempest-ServerActionsTestOtherB-1774572299'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732805.2463412) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:26:45.248379 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:26:45.248379 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:26:45.248982 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:26:45.249190 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:26:45.250194 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:26:45.250486 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:26:45.250644 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:26:45.250751 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:26:45.250926 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:26:45.251020 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:26:45.251526 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:26:45.251526 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:26:45.251526 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:26:45.252087 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:26:45.252087 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:26:45.252087 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:26:45.252207 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'vcpu_model' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:45.475122 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732805.4746466, 370e3cd7-4f2f-44c5-97d6-d314825a560a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:45.476757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] VM Started (Lifecycle Event)
May 14 04:26:45.662942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Found WWN 3300000002cc7dc72 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:45.663396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:45.663532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] <== connect_volume: return (4714ms) {'type': 'block', 'scsi_wwn': '3300000002cc7dc72', 'path': '/dev/dm-1', 'multipath_id': '3300000002cc7dc72'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:45.663532 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cc7dc72', 'path': '/dev/dm-1', 'multipath_id': '3300000002cc7dc72'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:45.664742 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.532s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:45.664742 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:45.676101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:45.676808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:45.677467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:45.677794 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:45.678251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:45.678461 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:45.698221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:45.698221 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:45.709466 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:45.709466 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21] added
May 14 04:26:45.715692 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:45.715692 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:45.715692 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:45.721511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21] added
May 14 04:26:45.721511 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:45.721511 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:45.721511 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:45.721511 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:45.721511 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:45.721511 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:45.721766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:45.721888 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0441(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:45.722053 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:45.731539 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:45.763763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:45.850372 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:45.854679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:45.854896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:45.855602 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:45.855940 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:45.856381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:45.856581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:45.935654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:45.980745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:45.982676 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732805.982231, 370e3cd7-4f2f-44c5-97d6-d314825a560a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:45.982785 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] VM Paused (Lifecycle Event)
May 14 04:26:46.173132 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-745630866',display_name='tempest-ServerStableDeviceRescueTest-server-745630866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverstabledevicerescuetest-server-745630866',id=6,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAci6SWH7DYnU3OQ7wwqiBWjKYBDwI40fqWKHcg0oJjrwHacFR2KTwRhEez9K8yY3e2SxIZYu8+NEs2T6qa3w0GdJzu5BLDCp479vU1b6G1ASQs92vA6WhdycehHbaBZ+A==',key_name='tempest-keypair-1510039878',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:32Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d49cec32e7e4e59ab41cd04147db756',ramdisk_id='',reservation_id='r-0h085c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-933200266',owner_user_name='tempest-ServerStableDeviceRescueTest-933200266-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5b93fa488e469cab3d35f0d0283061',uuid=b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "vif_mac": "fa:16:3e:40:ab:68"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:46.173373 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converting VIF {"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "vif_mac": "fa:16:3e:40:ab:68"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:46.174115 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:46.174809 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'pci_devices' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:46.486289 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:46.488846 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:46.676641 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:46.677905 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <uuid>b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</uuid>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <name>instance-00000006</name>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-745630866</nova:name>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:40</nova:creationTime>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:user uuid="5d5b93fa488e469cab3d35f0d0283061">tempest-ServerStableDeviceRescueTest-933200266-project-member</nova:user>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:project uuid="2d49cec32e7e4e59ab41cd04147db756">tempest-ServerStableDeviceRescueTest-933200266</nova:project>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         <nova:port uuid="cb034d60-b075-479f-9b34-57325e1c0d65">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="serial">b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="uuid">b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <alias name="ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <serial>10879ea1-3e25-4c10-bbc1-b357964a9ce8</serial>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.rescue"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <target dev="vdc" bus="virtio"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <boot order="1"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:40:ab:68"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <target dev="tapcb034d60-b0"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/console.log" append="off"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:46.677905 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:46.681392 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance destroyed successfully.
May 14 04:26:46.716213 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:46.722824 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:46.730306 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:46.730306 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:46.741626 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:46.741626 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.746827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.756098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.765991 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.767724 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.774854 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.775125 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:46.812925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.50.100,3260]
May 14 04:26:46.812925 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.50.100,3260] successful.
May 14 04:26:46.812925 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.824864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.832485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.40.100,3260]
May 14 04:26:46.832485 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.40.100,3260] successful.
May 14 04:26:46.832485 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.848385 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:46.848385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:46.849345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('13', '-', '-', 0) found on session 24 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:46.849498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:46.853846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:46.872539 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 24 and hctl ['13', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.875077 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:46.875389 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:46.876316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:46.876316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:46.876749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('14', '-', '-', 0) found on session 25 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:46.876882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:46.885603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:46.892122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 25 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:46.892122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:46.991484 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:47.166049 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:47.166049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:47.166049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:47.166526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:47.166680 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Processing event network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:26:47.166878 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:47.167037 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:47.167174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:47.167261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:47.167362 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] No waiting events found dispatching network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:47.167499 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received unexpected event network-vif-plugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 for instance with vm_state building and task_state spawning.
May 14 04:26:47.167649 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:47.167812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:47.168032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:47.168155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:47.168310 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Processing event network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:26:47.168487 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:47.168672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:47.168847 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:47.168992 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:47.169160 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] No waiting events found dispatching network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:47.169314 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-68cccac9-1275-45e7-815d-ae77db6eac86 req-2cfbba2d-1ccb-44f6-af79-036d503412a0 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received unexpected event network-vif-plugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e for instance with vm_state building and task_state spawning.
May 14 04:26:47.170321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:26:47.170997 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:26:47.174336 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:26:47.175672 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:26:47.176560 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732807.1761198, 370e3cd7-4f2f-44c5-97d6-d314825a560a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:47.179994 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] VM Resumed (Lifecycle Event)
May 14 04:26:47.187589 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Instance spawned successfully.
May 14 04:26:47.187589 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance spawned successfully.
May 14 04:26:47.187589 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:26:47.188218 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:26:47.689401 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:47.693796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:47.701432 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.703317 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.703743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.705092 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.705440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.708124 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.714161 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.714384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.715026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.715404 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.715758 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.716196 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:26:47.833519 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:47.873317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 24 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:47.873527 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:48.200036 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:26:48.200360 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732808.200127, 7000f23a-3a6a-40b1-8346-74d4b436e56a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:48.200546 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] VM Resumed (Lifecycle Event)
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] No VIF found with MAC fa:16:3e:40:ab:68, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:48.207147 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Using config drive
May 14 04:26:48.221146 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Took 8.33 seconds to spawn the instance on the hypervisor.
May 14 04:26:48.222381 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:48.231299 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Took 17.88 seconds to spawn the instance on the hypervisor.
May 14 04:26:48.236062 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:48.513917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:48.701429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Found WWN 3300000001dc6bb10 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:48.702179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:48.702179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== connect_volume: return (4570ms) {'type': 'block', 'scsi_wwn': '3300000001dc6bb10', 'path': '/dev/dm-7', 'multipath_id': '3300000001dc6bb10'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:48.702378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001dc6bb10', 'path': '/dev/dm-7', 'multipath_id': '3300000001dc6bb10'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:48.703965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:48.705866 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.127s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:48.706689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:48.711881 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'ec2_ids' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:48.723766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:48.738075 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:48.755041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.017s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:48.755556 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:48.757984 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Took 14.07 seconds to build instance.
May 14 04:26:48.763653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:48.765251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:48.765982 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:48.776720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:48.776720 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:48.784943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:48.784943 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:48.793199 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996] added
May 14 04:26:48.793199 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:48.793199 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:48.793199 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:48.793199 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:48.793199 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:48.793199 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:48.793681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:48.793681 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:48.793780 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:48.794895 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Took 30.65 seconds to build instance.
May 14 04:26:48.799970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996] added
May 14 04:26:48.799970 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:48.799970 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:48.799970 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:48.799970 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:48.799970 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:48.799970 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:48.800433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:48.800780 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:48.801044 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:49.223208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:26:49.223570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:26:49.223759 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:49.244785 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:49.244967 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'keypairs' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:49.266161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fc892542-72ed-409e-9904-c6e30a02ce08 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.592s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:49.297415 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:49.630509 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004319269999086828 future=<Future at 0x74361bf54740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:49.630668 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:49.630785 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.5421720320000532 future=<Future at 0x7436186b47a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:49.630785 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.5420823169999949 future=<Future at 0x7436186b47a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:49.632764 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d081d5dc-4e73-49a2-b887-a600c343129b None None] Emitting event <LifecycleEvent: 1778732794.6299353, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:49.633688 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d081d5dc-4e73-49a2-b887-a600c343129b None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Stopped (Lifecycle Event)
May 14 04:26:49.751496 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:49.755359 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:49.795678 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:49.801878 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:49.819654 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:49.819654 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:49.831573 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:49.831573 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.842685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.851951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.863509 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.863888 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.874313 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.874561 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:49.936365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260]
May 14 04:26:49.936365 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260] successful.
May 14 04:26:49.936365 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.955593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:49.962107 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Creating config drive at /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config.rescue
May 14 04:26:49.969135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeanlgr7f {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:49.984438 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:49.984846 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:49.986096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:49.986096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:49.987276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('15', '-', '-', 0) found on session 26 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:49.987420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:50.006283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 26 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:50.006283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:50.024193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeanlgr7f" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:50.135796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d081d5dc-4e73-49a2-b887-a600c343129b None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:50.523685 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.543032 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.547797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:50.547797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:50.547797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:50.547797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:50.547797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:50.549313 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Terminating instance
May 14 04:26:50.651790 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.735647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.847602 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.849406 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.853128 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.881661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:50.937010 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260]
May 14 04:26:50.937010 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260] successful.
May 14 04:26:50.937010 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:50.957564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:50.979910 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:50.980319 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:50.980679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.226s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:50.980679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:50.982779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('16', '-', '-', 0) found on session 27 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:50.983005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:51.008241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 27 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:51.008241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:51.055875 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:26:51.083066 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.090484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.120953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.151751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.152361 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.173844 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003910349998932361 future=<Future at 0x7436186b47a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:51.173844 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:51.174045 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Emitting event <LifecycleEvent: 1778732796.1728354, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:51.174293 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Stopped (Lifecycle Event)
May 14 04:26:51.360476 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:51.360872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:51.360872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:51.360872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:51.361038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] No waiting events found dispatching network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:51.361084 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df599a86-b0d7-4ebd-b37d-c485d55270d4 req-f7b2a683-3cda-43c1-87f9-e4b247bafdad service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:51.401693 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999660292000044 future=<Future at 0x74361bf540e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:51.402273 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99911758799999 future=<Future at 0x74361bf540e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:51.402440 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998860522000086 future=<Future at 0x74361bf540e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:51.405303 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Instance destroyed successfully.
May 14 04:26:51.406132 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lazy-loading 'resources' on Instance uuid 370e3cd7-4f2f-44c5-97d6-d314825a560a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:51.636733 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 due to new event <LifecycleEvent: 1778732811.6352823, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:26:51.636733 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732811.6352823, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:51.636733 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Resumed (Lifecycle Event)
May 14 04:26:51.642455 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2a275958-91c8-43a8-82ea-90e3e0085a88 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:51.677518 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:51.774562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.792946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:51.901207 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.910306 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-289762294',display_name='tempest-VolumesActionsTest-instance-289762294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-289762294',id=12,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:48Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='332cd017291346918295d9dfbf49fb0a',ramdisk_id='',reservation_id='r-k99vf0sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1928867020',owner_user_name='tempest-VolumesActionsTest-1928867020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:48Z,user_data=None,user_id='ff9421eb3ab146768fbebce716282eb4',uuid=370e3cd7-4f2f-44c5-97d6-d314825a560a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:26:51.912813 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converting VIF {"id": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "address": "fa:16:3e:1a:04:cd", "network": {"id": "7e009e7f-1328-4f7f-91ec-fde4db30903b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-597882639-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "332cd017291346918295d9dfbf49fb0a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape59ccca7-4f", "ovs_interfaceid": "e59ccca7-4f67-49b2-aed6-cc420e1d3a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:51.912813 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:51.912813 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:26:51.913469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.914410 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape59ccca7-4f, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:51.915484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.916644 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:51.916855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.918190 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.918369 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fc6094c-1557-439a-aa23-71969c06dc31) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:51.918937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.919428 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:51.920003 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:51.924681 np0000000747 nova-compute[97971]: INFO os_vif [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:04:cd,bridge_name='br-int',has_traffic_filtering=True,id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e,network=Network(7e009e7f-1328-4f7f-91ec-fde4db30903b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59ccca7-4f')
May 14 04:26:51.924681 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Deleting instance files /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a_del
May 14 04:26:51.924681 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Deletion of /opt/stack/data/nova/instances/370e3cd7-4f2f-44c5-97d6-d314825a560a_del complete
May 14 04:26:52.142540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:52.144170 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:52.434031 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 04:26:52.436684 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:26:52.436684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:26:52.436684 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:26:52.436962 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:52.528471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:52.528799 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:52.542471 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:52.655595 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732812.6540651, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:52.655595 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Started (Lifecycle Event)
May 14 04:26:52.796076 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:52.796523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:52.797383 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:52.797680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:52.797999 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:52.799771 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c77f0672-d687-41e4-a456-cdaa78aa1432 req-9a3f3b1e-bd38-4cfd-b1dc-ccc2de5a0464 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state rescued and task_state None.
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798922 for multipath device dm-8 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.118s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== connect_volume: return (8245ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798922', 'path': '/dev/dm-8', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798922'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798922', 'path': '/dev/dm-8', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798922'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.966s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:52.822676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:52.825384 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'flavor' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:52.848811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:52.852680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:52.852680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:52.852680 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:52.852680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:52.852680 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:52.873391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:52.873391 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:52.883285 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:52.883285 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:26:52.894124 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:52.894124 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:52.894124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:52.894382 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0436(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:52.894424 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:52.899793 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe] added
May 14 04:26:52.899793 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:52.899793 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:52.899793 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:52.899793 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:52.899793 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:52.899793 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:52.900150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:52.900425 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.049(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:52.900640 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:53.035108 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:53.113847 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-25686c56-cdad-4aa6-91d4-61dfaf8ebf47 req-e75f3c19-0be4-4f12-baa9-37bf2cc23930 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-deleted-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:53.114347 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-25686c56-cdad-4aa6-91d4-61dfaf8ebf47 req-e75f3c19-0be4-4f12-baa9-37bf2cc23930 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Neutron deleted interface e59ccca7-4f67-49b2-aed6-cc420e1d3a7e; detaching it from the instance and deleting it from the info cache
May 14 04:26:53.114548 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-25686c56-cdad-4aa6-91d4-61dfaf8ebf47 req-e75f3c19-0be4-4f12-baa9-37bf2cc23930 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:53.157222 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:53.162415 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:53.331304 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attempting to attach volume c040e303-a25c-41fa-bebc-296f7d894996 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:26:53.332918 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:   <alias name="ua-c040e303-a25c-41fa-bebc-296f7d894996"/>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:   <serial>c040e303-a25c-41fa-bebc-296f7d894996</serial>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]: </disk>
May 14 04:26:53.332918 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:26:53.378784 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Unrescuing
May 14 04:26:53.378880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:53.378930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:53.379120 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:53.466056 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:53.466296 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] Acquiring lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:53.466495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:53.466668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:53.466840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] No waiting events found dispatching network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:53.467040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-00b44418-3202-43fe-9621-d49f68b8c661 req-10b6501f-dade-44ca-bd2c-1cae53274b56 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Received event network-vif-unplugged-e59ccca7-4f67-49b2-aed6-cc420e1d3a7e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:26:53.541864 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:53.604956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:53.604956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:53.608561 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:53.608762 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Claim successful on node np0000000747
May 14 04:26:53.618560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-25686c56-cdad-4aa6-91d4-61dfaf8ebf47 req-e75f3c19-0be4-4f12-baa9-37bf2cc23930 service nova] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Detach interface failed, port_id=e59ccca7-4f67-49b2-aed6-cc420e1d3a7e, reason: Instance 370e3cd7-4f2f-44c5-97d6-d314825a560a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:26:53.669188 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 04:26:53.881993 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:53.894853 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:53.901733 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:53.917195 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:53.917195 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:53.925423 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:53.925423 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:53.937006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:53.947803 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.963965 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.964524 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:53.973843 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:54.022095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:26:54.022095 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:26:54.022095 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:54.041813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:54.044249 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:26:54.044249 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:26:54.044249 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:54.046204 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Took 1.61 seconds to deallocate network for instance.
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.066651 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.067129 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:54.067129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:54.067681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:54.068623 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('17', '-', '-', 0) found on session 28 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:54.068836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:54.070871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:54.100136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 28 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:54.100136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:54.107647 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:54.107647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] HCTL ('18', '-', '-', 0) found on session 29 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:54.109708 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:54.132419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Searching for a device in session 29 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:54.132419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:54.265645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:54.265645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:54.318051 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:54.318750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:54.390720 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:54.557414 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:54.565126 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:54.767455 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:54.825739 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:54.851127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:54.881277 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:54.881804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:54.881997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:54.882148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:54.882343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:54.882518 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state rescued and task_state unrescuing.
May 14 04:26:54.882696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:54.882858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing instance network info cache due to event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:54.883070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:55.004340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:55.004549 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:55.004713 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:26:55.004944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:fb:39:88, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:26:55.068604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:55.068604 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'flavor' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:55.069137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:55.069137 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:55.165329 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:55.165576 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:55.324423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:55.380394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:55.572077 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:55.590961 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.593078 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.612110 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.616577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.640201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.668688 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:55.736442 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.869490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Found WWN 3300000000e5614a0 for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:55.869490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:55.870184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== connect_volume: return (10012ms) {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-9', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:55.870184 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e5614a0', 'path': '/dev/dm-9', 'multipath_id': '3300000000e5614a0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:55.870506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.647s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:55.870879 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:26:55.880724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.884280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:55.885472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:55.887100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:26:55.887597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:55.887868 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:55.888824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:26:55.888824 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:55.905364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:55.905364 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:55.910086 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:26:55.910086 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:55.925701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad] added
May 14 04:26:55.925701 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:55.925701 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:55.925701 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:55.925701 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:55.925701 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:55.925701 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:55.926071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:55.926141 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:55.926239 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:55.927475 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999815800000079 future=<Future at 0x7435f8567c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:26:55.928568 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad] added
May 14 04:26:55.928568 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:26:55.928568 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:55.928568 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:55.928568 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:26:55.928568 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:26:55.928568 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:55.928853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:26:55.929690 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:26:55.930011 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:26:55.930137 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance destroyed successfully.
May 14 04:26:55.931529 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'numa_topology' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:55.937259 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:56.093527 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updated VIF entry in instance network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:26:56.093888 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:56.178322 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.573s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:56.179183 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.621s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:56.181139 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:26:56.382054 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:29Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:56.382343 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:56.382831 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:56.384534 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <uuid>46c1f391-bb33-4215-9e23-0d7999c5fc87</uuid>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <name>instance-00000003</name>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherB-server-438362794</nova:name>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:45</nova:creationTime>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:user uuid="5a9f12c806cf4682a13e57b5866d94df">tempest-ServerActionsTestOtherB-1774572299-project-member</nova:user>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:project uuid="f5ff321993c84c0d9681976a6cce4a8e">tempest-ServerActionsTestOtherB-1774572299</nova:project>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         <nova:port uuid="5088963d-83e8-4f8a-afab-b4d7c1a9b5c5">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="serial">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="uuid">46c1f391-bb33-4215-9e23-0d7999c5fc87</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/disk.config"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <alias name="ua-37e1df64-4e5a-460c-9776-48fc8b73d1fe"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-9"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <serial>37e1df64-4e5a-460c-9776-48fc8b73d1fe</serial>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e5:d2:fb"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <target dev="tap5088963d-83"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87/console.log" append="off"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:56.384534 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Preparing to wait for external event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:29Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:56.386574 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:56.387969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.387969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:56.387969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:56.388267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.388492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb85651e-e26e-55d5-876b-4161a471977e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:56.389862 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.390907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:56.397187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.399935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.400189 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5088963d-83, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:56.400671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5088963d-83, col_values=(('qos', UUID('23fae225-1590-458a-9928-313ab8d78bbe')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:56.401411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5088963d-83, col_values=(('external_ids', {'iface-id': '5088963d-83e8-4f8a-afab-b4d7c1a9b5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:d2:fb', 'vm-uuid': '46c1f391-bb33-4215-9e23-0d7999c5fc87'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:56.402142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.403292 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:56.416489 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:56.418352 np0000000747 nova-compute[97971]: INFO os_vif [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:26:56.434085 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Object Instance<b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:26:56.560807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-05bbeafd-ae98-4f5b-9a99-f44a5976cdcf tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.680s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing instance network info cache due to event network-changed-cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Acquiring lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Acquired lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:56.598119 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Refreshing network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:56.690309 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:26:56.691504 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:26:56.691859 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:56.692144 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:56.814426 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:26:56.849206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:56.849541 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:56.926787 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:26:56.930411 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:56.943532 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:56.943532 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:26:56.949943 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:26:56.949943 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:56.956436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:56.964449 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.977635 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.978153 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:56.994545 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:57.045517 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.50.100,3260]
May 14 04:26:57.045517 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.50.100,3260] successful.
May 14 04:26:57.045517 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:57.066646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.092021 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:57.092021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:57.092685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.40.100,3260]
May 14 04:26:57.092685 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.40.100,3260] successful.
May 14 04:26:57.092685 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:57.093755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('19', '-', '-', 0) found on session 30 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:57.094115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:57.099873 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:57.115870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:26:57.115870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 30 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:57.115870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.145429 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:26:57.146092 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:26:57.146092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.258s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:57.146500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:26:57.148195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] HCTL ('20', '-', '-', 0) found on session 31 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:26:57.148270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:26:57.172867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Searching for a device in session 31 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:26:57.172867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:26:57.196689 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:26:57.354471 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:26:57.362387 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.400808 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.494257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.530275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.532842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.615609 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.624597 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Successfully created port: c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:26:57.651504 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:57.701949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:26:57.757629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.787678 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.792764 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.824403 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:57.854700 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-713d08f6-8609-4ea7-8e59-5cb16ebc75c7 req-147b78f4-59ac-4ffd-b9dd-ffce4e480a8f service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:57.855642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-713d08f6-8609-4ea7-8e59-5cb16ebc75c7 req-147b78f4-59ac-4ffd-b9dd-ffce4e480a8f service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:57.855642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-713d08f6-8609-4ea7-8e59-5cb16ebc75c7 req-147b78f4-59ac-4ffd-b9dd-ffce4e480a8f service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:57.855922 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-713d08f6-8609-4ea7-8e59-5cb16ebc75c7 req-147b78f4-59ac-4ffd-b9dd-ffce4e480a8f service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:57.855922 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-713d08f6-8609-4ea7-8e59-5cb16ebc75c7 req-147b78f4-59ac-4ffd-b9dd-ffce4e480a8f service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Processing event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:26:57.869495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.691s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:57.877725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.553s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:57.886445 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:26:57.886631 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Claim successful on node np0000000747
May 14 04:26:57.897166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:26:57.954872 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updated VIF entry in instance network info cache for port cb034d60-b075-479f-9b34-57325e1c0d65. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:26:57.954872 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [{"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:57.957013 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Deleted allocations for instance 370e3cd7-4f2f-44c5-97d6-d314825a560a
May 14 04:26:58.224588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:58.224999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:58.282810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:58.285718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:58.288107 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:58.318249 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:58.369680 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Successfully updated port: c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:26:58.435711 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:58.435711 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing instance network info cache due to event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:26:58.435917 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] Acquiring lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:58.436008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] Acquired lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:58.436605 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing network info cache for port c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:26:58.466780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2b7ff1f-e424-4cc9-a08a-e872d7dda3b5 req-b9d58d90-197d-4fc3-858b-e920a62e2c12 service nova] Releasing lock "refresh_cache-b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:58.576433 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Rebuilding instance
May 14 04:26:58.598897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 due to new event <LifecycleEvent: 1778732818.5985174, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:26:58.599041 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732818.5985174, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:58.599140 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Resumed (Lifecycle Event)
May 14 04:26:58.601397 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-643ae5c6-afb4-44e4-8e19-f7adc23cc4c1 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:58.653841 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:26:58.657266 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance running successfully.
May 14 04:26:58.657687 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] finish_revert_migration finished successfully. {{(pid=97971) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 14 04:26:58.726947 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:26:58.728718 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:26:58.729465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:26:58.734150 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Creating image(s)
May 14 04:26:58.743494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:58.743834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:58.747926 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:58.750194 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:58.753120 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:58.755705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:58.784648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:58.861056 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:58.861490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:58.861999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:58.862482 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:58.865864 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:26:58.866681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:58.881970 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:26:58.919034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Found WWN 330000000fd324428 for multipath device dm-10 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:26:58.919453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:26:58.919637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== connect_volume: return (9695ms) {'type': 'block', 'scsi_wwn': '330000000fd324428', 'path': '/dev/dm-10', 'multipath_id': '330000000fd324428'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:26:58.919803 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fd324428', 'path': '/dev/dm-10', 'multipath_id': '330000000fd324428'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:26:58.942661 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:26:58.949969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:58.950887 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:58.992047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a4987c3a-0cd4-44b1-91cd-d43767c40282 tempest-VolumesActionsTest-1928867020 tempest-VolumesActionsTest-1928867020-project-member] Lock "370e3cd7-4f2f-44c5-97d6-d314825a560a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.446s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:58.998747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk 1073741824" returned: 0 in 0.048s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:58.999533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.137s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:58.999533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:59.077516 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:26:59.102639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:26:59.105271 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:26:59.112517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:59.113046 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:26:59.113345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:26:59.220067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:26:59.221023 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:26:59.221491 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:26:59.222095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Ensure instance console log exists: /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:26:59.222324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.222754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.223165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.338081 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.345528 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:59.347578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.347578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.347578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.347578 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:59.347578 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-59589e78-35c9-4732-95ff-77a2360e8edb req-b803848a-229d-42d3-b4de-9a7eeccb8b48 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state None.
May 14 04:26:59.385008 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:26:59.431845 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.431845 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.431845 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.433550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.434337 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.435652 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.437159 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.438522 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.439859 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.441172 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.441904 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.443020 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.444546 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.445661 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.446891 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.447552 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.447963 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.448721 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.449789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:26:59.450298 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.451200 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.453429 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lazy-loading 'pci_devices' on Instance uuid 4da473ba-6f29-4334-b061-1d1d34f65717 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:26:59.628418 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732819.628041, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:26:59.628577 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Started (Lifecycle Event)
May 14 04:26:59.679583 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:26:59.679975 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:26:59.727887 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d004db2e-8298-4c53-a8fa-5b6164254ab0 tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance to original state: 'active'
May 14 04:26:59.825485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.829355 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.863777 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.889919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e95157cf-c512-4c7e-9730-133d883163a5 req-6ea6d1d5-a1b4-4104-9e96-f702986dbb9d service nova] Releasing lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:26:59.890511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:26:59.890703 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:26:59.926607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:59.926852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.926998 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.927107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.927224 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:59.927322 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received unexpected event network-vif-plugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with vm_state active and task_state None.
May 14 04:26:59.927434 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:26:59.927549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.927695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.927806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.927930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:26:59.931725 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2a3e5d1e-ebb8-4e3f-ac79-7aadc8530994 req-b3546c00-0a26-4af7-ac1b-0c1ffed9b75f service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received unexpected event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with vm_state building and task_state spawning.
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] End _get_guest_xml xml=<domain type="qemu">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <uuid>4da473ba-6f29-4334-b061-1d1d34f65717</uuid>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <name>instance-0000000a</name>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:name>tempest-device-tagging-server-1697871458</nova:name>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:26:40</nova:creationTime>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:user uuid="880be5c4e79e4884bf63d220ef7cfd04">tempest-TaggedBootDevicesTest-986832132-project-member</nova:user>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:project uuid="93dd24bcdb5043d9b23426bea16778cb">tempest-TaggedBootDevicesTest-986832132</nova:project>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="0b752b51-9720-4646-9cc2-bf7aa483b3a0">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="12868c4f-d9e7-4d6c-80bb-07382344b782">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="5957b670-2b91-4059-9b2b-6ff7707d41d9">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="94f74dab-b8f0-4b58-b8e9-f291299ec4c0">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="2103083d-c391-40bf-8a73-79aea110acb4">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="2bdfb3b0-76cc-4c8f-8737-04b5c6682806">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         <nova:port uuid="ce562d2b-9682-4f0d-a82a-4061d061deec">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <system>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="serial">4da473ba-6f29-4334-b061-1d1d34f65717</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="uuid">4da473ba-6f29-4334-b061-1d1d34f65717</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </system>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <os>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </os>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <features>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </features>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   <devices>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/disk.config"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <alias name="ua-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <serial>30c2f68f-3115-4040-9e7e-9f3f1d87fbbb</serial>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <alias name="ua-5a8a54d2-9207-45f3-9d16-8b73a48a5e21"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-7"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <serial>5a8a54d2-9207-45f3-9d16-8b73a48a5e21</serial>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <alias name="ua-2e17f69b-e90f-4c84-a87e-091ca8b44aad"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-10"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="vdc" bus="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <serial>2e17f69b-e90f-4c84-a87e-091ca8b44aad</serial>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </disk>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:2f:f0:df"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap0b752b51-97"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:7e:09:68"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap12868c4f-d9"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1b:4f:9e"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap5957b670-2b"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:a2:e0:44"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap94f74dab-b8"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:8a:1b:a3"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap2103083d-c3"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:3c:ec:26"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tap2bdfb3b0-76"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:fb:04:24"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <target dev="tapce562d2b-96"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </interface>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/console.log" append="off"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </serial>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <video>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </video>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </rng>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:   </devices>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: </domain>
May 14 04:26:59.963167 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.963167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Preparing to wait for external event network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:26:59.971984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:59.972807 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:26:59.976781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.976951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a083fcea-823d-50be-9101-db30783e3e2e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:59.978117 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:26:59.988167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.990764 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.990962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b752b51-97, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:59.991339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b752b51-97, col_values=(('qos', UUID('98f53217-c509-494e-abdd-5d18597bfa63')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:59.991458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b752b51-97, col_values=(('external_ids', {'iface-id': '0b752b51-9720-4646-9cc2-bf7aa483b3a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:f0:df', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:26:59.994785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:26:59.996185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.004648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.005970 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97')
May 14 04:27:00.006492 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.006673 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.007445 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.007649 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.010853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.011101 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.011256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.016689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.016874 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26687bf0-52e3-5638-be74-53c749241db7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.017634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.018524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.030251 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.035969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.036172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12868c4f-d9, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.037801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12868c4f-d9, col_values=(('qos', UUID('910bc0e5-cf87-4d66-bd64-20aa681b2f49')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.037801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12868c4f-d9, col_values=(('external_ids', {'iface-id': '12868c4f-d9e7-4d6c-80bb-07382344b782', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:09:68', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.037801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.039339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.051939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.053020 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9')
May 14 04:27:00.053700 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.054293 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.054516 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.054780 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.054986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.055148 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.055320 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.060304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.060738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7cbb2d9-9221-5faa-a492-82147e2f1390', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.061304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.062135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.079915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.083933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.083933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5957b670-2b, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.084194 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5957b670-2b, col_values=(('qos', UUID('c8cce7b9-38d0-41d4-8cb0-85ada5220656')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.085984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5957b670-2b, col_values=(('external_ids', {'iface-id': '5957b670-2b91-4059-9b2b-6ff7707d41d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:4f:9e', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.085984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.086415 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.109248 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b')
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.112909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.114751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.114968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41619afa-8afd-5b42-bfab-ca438f365dca', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.122404 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.122669 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.131767 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:00.137817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:00.141107 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance destroyed successfully.
May 14 04:27:00.153811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.167147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.167147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94f74dab-b8, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.167147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94f74dab-b8, col_values=(('qos', UUID('6804fd9c-2fe3-4c1c-907a-36e167c3ba35')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.167147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94f74dab-b8, col_values=(('external_ids', {'iface-id': '94f74dab-b8f0-4b58-b8e9-f291299ec4c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:e0:44', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.168700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.169965 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.185536 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:00.199727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.201673 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8')
May 14 04:27:00.202727 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.202978 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.205192 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.205528 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.205924 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.206135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.206302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.207796 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.207954 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a84cee15-1864-5bdb-a716-55bfeedfaa70', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.210631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.212060 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.238219 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Detaching volume c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:27:00.244406 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.253008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.253157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2103083d-c3, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.253975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2103083d-c3, col_values=(('qos', UUID('4426f726-b05d-4171-b916-6237e58634df')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.256082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2103083d-c3, col_values=(('external_ids', {'iface-id': '2103083d-c391-40bf-8a73-79aea110acb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:1b:a3', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.260156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.261510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.288176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.289417 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3')
May 14 04:27:00.290370 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.290586 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.291259 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.291561 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f92828-1e67-50e7-b3e1-5ea57c33f86f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.296169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.296873 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.298558 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attempting to driver detach volume c040e303-a25c-41fa-bebc-296f7d894996 from mountpoint /dev/vdb
May 14 04:27:00.308681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found disk vdb by alias ua-c040e303-a25c-41fa-bebc-296f7d894996 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:00.308681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Attempting to detach device vdb from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:27:00.308681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <alias name="ua-c040e303-a25c-41fa-bebc-296f7d894996"/>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <serial>c040e303-a25c-41fa-bebc-296f7d894996</serial>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:00.308681 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:00.315026 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully detached device vdb from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the persistent domain config.
May 14 04:27:00.317295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:27:00.317652 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:00.319277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:00.328071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.329893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.330069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdfb3b0-76, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.330352 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdfb3b0-76, col_values=(('qos', UUID('9ee3e962-abbd-4b53-838d-4dd266c64857')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.330483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdfb3b0-76, col_values=(('external_ids', {'iface-id': '2bdfb3b0-76cc-4c8f-8737-04b5c6682806', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:ec:26', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.331144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.333923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.364388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.364388 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76')
May 14 04:27:00.364388 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:00.364388 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:00.364388 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:00.365242 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:00.365242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.365242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.365242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:00.365763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.365906 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18c45a38-b135-5d80-8fbd-af43d6c2e822', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.367017 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.367971 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.401849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.408312 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.408634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce562d2b-96, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.409101 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce562d2b-96, col_values=(('qos', UUID('41042e5e-506e-437e-bdbb-82762523e76e')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.409242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce562d2b-96, col_values=(('external_ids', {'iface-id': 'ce562d2b-9682-4f0d-a82a-4061d061deec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:04:24', 'vm-uuid': '4da473ba-6f29-4334-b061-1d1d34f65717'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:00.411940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.413175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:00.463644 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.463644 np0000000747 nova-compute[97971]: INFO os_vif [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96')
May 14 04:27:00.482421 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:00.540909 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received unexpected event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with vm_state active and task_state rebuilding.
May 14 04:27:00.541354 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:00.541354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:00.541354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:00.541460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:00.541606 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:00.542054 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-38985a10-4a4f-4307-95d8-a02a25fac90a req-5934cb0a-cf22-48b9-a657-5837abe75d7e service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received unexpected event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with vm_state active and task_state rebuilding.
May 14 04:27:00.639778 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732820.639394, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:00.639994 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Started (Lifecycle Event)
May 14 04:27:00.675319 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:00.694973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.818s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:00.695355 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:00.698187 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.319s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:00.705605 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:27:00.705762 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Claim successful on node np0000000747
May 14 04:27:00.736733 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:00.837271 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:01.142634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:01.144470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:01.203831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:01.203925 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:01.205665 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:01.206711 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:01.287224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.287483 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.287696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.287781 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.287932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:01.290744 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Terminating instance
May 14 04:27:01.307434 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6f5bedbcf3d461b89449de1f1ed3f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09c55a931624a709a3721d199eecd5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:01.341538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:01.342779 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance network_info: |[{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:01.346641 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Start _get_guest_xml network_info=[{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:01.351706 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:01.351706 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='9ab87dcf-3d40-4cfe-812d-bc19d06f3270'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732821.3504028) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:01.352221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:01.352221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:01.355925 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:01.356310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:01.357364 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:01.357948 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:01.358111 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:01.359807 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:01.359858 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:01.360029 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:01.360178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:01.360362 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:01.360495 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:01.361733 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:01.361866 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:01.362099 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:01.385571 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=13,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-508hzxs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=9ab87dcf-3d40-4cfe-812d-bc19d06f3270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:01.386461 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:01.386461 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:01.388829 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:01.438896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:01.438896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.439077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.439190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:01.439344 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:01.439471 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state None.
May 14 04:27:01.439597 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:01.439916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.439916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.440023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:01.440104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:01.441608 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state None.
May 14 04:27:01.442068 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:01.446686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.447308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.447562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:01.447904 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:01.448101 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7302a36d-325f-4ab3-947b-12db85263c2a req-5f961b3a-0562-4bd4-877e-9b4723e19585 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received unexpected event network-vif-plugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with vm_state active and task_state None.
May 14 04:27:01.647790 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] During sync_power_state the instance has a pending task (deleting). Skip.
May 14 04:27:01.648033 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732821.6478534, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:01.648243 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Paused (Lifecycle Event)
May 14 04:27:01.709915 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:01.801562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:27:01.856704 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Successfully created port: ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:01.890996 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <uuid>9ab87dcf-3d40-4cfe-812d-bc19d06f3270</uuid>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <name>instance-0000000d</name>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-0</nova:name>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:01</nova:creationTime>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         <nova:port uuid="c8645ad6-8a83-4f7b-8466-37d93e660471">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="serial">9ab87dcf-3d40-4cfe-812d-bc19d06f3270</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="uuid">9ab87dcf-3d40-4cfe-812d-bc19d06f3270</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.config"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:db:64:7f"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <target dev="tapc8645ad6-8a"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/console.log" append="off"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:01.890996 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Preparing to wait for external event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=13,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-508hzxs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=9ab87dcf-3d40-4cfe-812d-bc19d06f3270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:01.895206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:01.896267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.896267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9162a1ec-ef24-52fc-ab78-3121300221a9', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:01.898119 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:01.913559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.937696 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.986888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.988416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.990959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:01.990959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:01.990959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] No VIF found with MAC fa:16:3e:2f:f0:df, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:01.990959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] No VIF found with MAC fa:16:3e:8a:1b:a3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:01.990959 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Using config drive
May 14 04:27:01.991652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:01.991829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8645ad6-8a, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:01.992186 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8645ad6-8a, col_values=(('qos', UUID('3f385efb-aaa9-42c0-970b-0dc2115d0c89')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:01.992358 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8645ad6-8a, col_values=(('external_ids', {'iface-id': 'c8645ad6-8a83-4f7b-8466-37d93e660471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:64:7f', 'vm-uuid': '9ab87dcf-3d40-4cfe-812d-bc19d06f3270'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:01.998157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:02.010844 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.060432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.110936 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:02.111084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:02.111243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:02.111343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:02.111462 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:02.111593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5f97ca5-1eed-48f5-92bc-f829ce5def9b req-0df98b8e-0003-4380-ba07-b784e4c93dee service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:27:02.128811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.133822 np0000000747 nova-compute[97971]: INFO os_vif [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a')
May 14 04:27:02.153126 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:02.171198 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732822.1707358, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:02.172234 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Resumed (Lifecycle Event)
May 14 04:27:02.175051 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Instance destroyed successfully.
May 14 04:27:02.177367 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lazy-loading 'resources' on Instance uuid 46c1f391-bb33-4215-9e23-0d7999c5fc87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:02.222307 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:02.428680 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:02.429079 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:02.505395 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:02.524709 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Successfully updated port: ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:02.675344 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:02.684664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-438362794',display_name='tempest-ServerActionsTestOtherB-server-438362794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestotherb-server-438362794',id=3,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjrk6ib1iVP6FD1FtvTMe6IzuV91gIzjLa7xN92z8VP/n49q3i2A1/q9lKcRE/wML03jgA4efiPR3/yL5Us3mtLxB3K4mW6SE0MDnnHJHqoY+AmZlFklO9FncHbZtxFSg==',key_name='tempest-keypair-279596225',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:59Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5ff321993c84c0d9681976a6cce4a8e',ramdisk_id='',reservation_id='r-otu2lhgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1774572299',owner_user_name='tempest-ServerActionsTestOtherB-1774572299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a9f12c806cf4682a13e57b5866d94df',uuid=46c1f391-bb33-4215-9e23-0d7999c5fc87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:27:02.684664 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converting VIF {"id": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "address": "fa:16:3e:e5:d2:fb", "network": {"id": "7927b72e-d907-4f1d-88af-a1025162bcc1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1052752648-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5ff321993c84c0d9681976a6cce4a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5088963d-83", "ovs_interfaceid": "5088963d-83e8-4f8a-afab-b4d7c1a9b5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:02.684664 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:02.685228 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:27:02.689011 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Creating config drive at /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/disk.config
May 14 04:27:02.689673 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999832190000006 future=<Future at 0x7435f85efc20 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:02.689849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.690172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5088963d-83, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:02.691124 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999876680999932 future=<Future at 0x74361824b0e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:02.691724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.692911 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:02.696057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp537r5erc {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:02.738025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.739222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.739409 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23fae225-1590-458a-9928-313ab8d78bbe) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:02.740293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.741142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:02.745272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp537r5erc" returned: 0 in 0.049s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:02.787954 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:02.791557 np0000000747 nova-compute[97971]: INFO os_vif [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:d2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5088963d-83e8-4f8a-afab-b4d7c1a9b5c5,network=Network(7927b72e-d907-4f1d-88af-a1025162bcc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5088963d-83')
May 14 04:27:02.796705 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:27:02.796705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:02.796705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:02.932264 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:03.026784 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:03.026956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquired lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:03.027047 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:03.188955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.871s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:03.189236 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:27:03.189382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.225034 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.225391 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:03.225391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '33')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:27:03.225867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '27')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:03.230481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '26')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:03.234832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f85e7c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:27:03.236162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:27:03.236473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flush multipath device 3300000001b61f96e {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:27:03.240639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:03.240639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:03.240639 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Creating image(s)
May 14 04:27:03.240920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:03.241075 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:03.242424 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:03.242990 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:03.247244 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:03.248305 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:03.277772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:03.286299 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.333262 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:03.363069 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:03.365402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:03.366277 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:03.366277 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:03.375940 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:03.375940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:03.375940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.400145 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:27:03.400145 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:27:03.408165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:27:03.431836 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.437303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:27:03.437838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:27:03.444208 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.746s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:03.444968 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:03.449470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.112s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:03.457949 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:27:03.458102 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Claim successful on node np0000000747
May 14 04:27:03.466969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.498247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.124s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:03.500289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:03.526667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260]
May 14 04:27:03.526667 np0000000747 nova-compute[97971]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260] successful.
May 14 04:27:03.526667 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.553201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.562015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.568100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk 1073741824" returned: 0 in 0.067s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:03.568100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:03.568100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:03.588116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.602624 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-changed-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:03.608226 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Refreshing instance network info cache due to event network-changed-ba6c2eff-a446-4a05-b7e7-8c029f9d431c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:03.611890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.616813 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] Acquiring lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:03.620630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.629005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260]
May 14 04:27:03.629005 np0000000747 nova-compute[97971]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260] successful.
May 14 04:27:03.629005 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.640939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.676797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:03.677078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:03.677258 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:db:64:7f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:03.677984 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Using config drive
May 14 04:27:03.681604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.682008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.493s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:03.682173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== disconnect_volume: return (3364ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:03.683608 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:27:03.690874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:03.694687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.897s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:03.699082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37e1df64-4e5a-460c-9776-48fc8b73d1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:27:03.699273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:27:03.699964 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:03.708158 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:03.712503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:03.730457 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.749917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.755119 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:03.755635 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '33')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:27:03.755635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '28')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:03.756960 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe', '29')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:03.758737 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84114e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'): ({'sdm'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:27:03.758737 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Removing multipathed devices sdm, sdl {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:27:03.758737 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Flush multipath device 3300000000e5614a0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:27:03.767714 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.797447 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.801736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:03.801736 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.812912 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:03.814806 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Cannot resize image /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:03.815335 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:03.815550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Ensure instance console log exists: /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:03.815959 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:03.826163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:03.826163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:03.856623 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:03.865374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.888233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.906913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:27:03.907102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:27:03.910038 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:27:03.922388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:03.927772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:27:03.928112 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:27:03.950092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:03.958270 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:03.958270 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:03.958582 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:03.959075 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:03.978481 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.013279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260]
May 14 04:27:04.013279 np0000000747 nova-compute[97971]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.40.100,3260] successful.
May 14 04:27:04.013279 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:04.024451 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-44b6d73a-e277-4589-9c05-a9175fd5d69f req-dcf773d8-9ac7-4d50-8c96-14bfc6e90f9f service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:04.024788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-44b6d73a-e277-4589-9c05-a9175fd5d69f req-dcf773d8-9ac7-4d50-8c96-14bfc6e90f9f service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:04.024927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-44b6d73a-e277-4589-9c05-a9175fd5d69f req-dcf773d8-9ac7-4d50-8c96-14bfc6e90f9f service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:04.027638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-44b6d73a-e277-4589-9c05-a9175fd5d69f req-dcf773d8-9ac7-4d50-8c96-14bfc6e90f9f service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:04.027638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-44b6d73a-e277-4589-9c05-a9175fd5d69f req-dcf773d8-9ac7-4d50-8c96-14bfc6e90f9f service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:04.051639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:04.058068 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.074682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:04.102640 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:04.132911 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.135074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.141476 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260]
May 14 04:27:04.141476 np0000000747 nova-compute[97971]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-37e1df64-4e5a-460c-9776-48fc8b73d1fe, portal: 192.168.50.100,3260] successful.
May 14 04:27:04.141476 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:04.179872 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.182119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:04.183198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:04.183198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] <== disconnect_volume: return (1385ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:04.183198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:27:04.183198 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Deleting instance files /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_del
May 14 04:27:04.198670 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:04.202179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.211356 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Deletion of /opt/stack/data/nova/instances/46c1f391-bb33-4215-9e23-0d7999c5fc87_del complete
May 14 04:27:04.228219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:04.228219 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] Acquiring lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:04.228406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:04.228436 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:04.228584 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] No waiting events found dispatching network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:04.229173 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a1709231-6490-4260-81a0-4ff0fe87dd82 req-695dd5df-ce83-4d5b-ae6c-d6d6c284e02d service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-unplugged-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:27:04.236901 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6f5bedbcf3d461b89449de1f1ed3f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09c55a931624a709a3721d199eecd5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:04.241694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.362380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.462801 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:04.484047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.510101 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Creating config drive at /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.config
May 14 04:27:04.511921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.531532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv09qjsct {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:04.580784 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.599639 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating instance_info_cache with network_info: [{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:04.601925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv09qjsct" returned: 0 in 0.071s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:04.722190 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Took 2.92 seconds to destroy the instance on the hypervisor.
May 14 04:27:04.722190 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:27:04.722531 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:27:04.722694 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:27:04.724002 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:04.836577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.844574 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance destroyed successfully.
May 14 04:27:04.847040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-ServerActionsTestOtherA-server-330518108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:00Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:27:04.848569 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:04.848569 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:04.849034 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:27:04.851356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.852055 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd14b0b96-59, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:04.853874 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.856113 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:04.861586 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.863794 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.864004 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7ecad04-97e2-4314-8b93-b0ab7ca1c83f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:04.865257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.866222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:04.875157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:04.878278 np0000000747 nova-compute[97971]: INFO os_vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59')
May 14 04:27:04.889975 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:27:04.892196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:04.892389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:04.892873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:04.893161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:27:04.893327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:27:04.908123 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:04.969171 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:04.973502 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:04.973502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292', '33')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:27:04.974360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:04.974360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:27:04.974360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:04.977374 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:27:04.977560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f85949a0>, {}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:27:04.977666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Disconnecting from: [] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:27:04.978007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:04.978007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== disconnect_volume: return (85ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:04.978533 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:27:04.983421 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Deleting instance files /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d_del
May 14 04:27:04.991150 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Deletion of /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d_del complete
May 14 04:27:05.041361 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.048600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.101817 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Releasing lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:05.102092 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Instance network_info: |[{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:05.102662 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] Acquired lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:05.105456 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Refreshing network info cache for port ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:05.107413 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Start _get_guest_xml network_info=[{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:05.113936 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:05.115396 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-443863854-1', uuid='29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493'), owner=OwnerMeta(userid='e6f5bedbcf3d461b89449de1f1ed3f71', username='tempest-TestMultiAttachVolumeSwap-1644439510-project-member', projectid='d09c55a931624a709a3721d199eecd5f', projectname='tempest-TestMultiAttachVolumeSwap-1644439510'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732825.1149619) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:05.120496 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:05.120496 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:05.122461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:05.126646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:05.128020 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:05.128389 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:05.128549 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:05.128681 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:05.128835 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:05.128952 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:05.129077 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:05.129433 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:05.129577 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:05.129748 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:05.129883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:05.130026 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:05.143244 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-1',id=14,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:05.143536 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:05.144029 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:05.144969 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'pci_devices' on Instance uuid 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:05.244725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.256734 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.278067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.283596 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.332359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:05.332359 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:05.423754 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.464270 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732825.4638288, 4da473ba-6f29-4334-b061-1d1d34f65717 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:05.465398 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] VM Started (Lifecycle Event)
May 14 04:27:05.603193 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Successfully created port: 08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:05.611991 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:05.650876 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <uuid>29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493</uuid>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <name>instance-0000000e</name>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-443863854-1</nova:name>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:05</nova:creationTime>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:user uuid="e6f5bedbcf3d461b89449de1f1ed3f71">tempest-TestMultiAttachVolumeSwap-1644439510-project-member</nova:user>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:project uuid="d09c55a931624a709a3721d199eecd5f">tempest-TestMultiAttachVolumeSwap-1644439510</nova:project>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         <nova:port uuid="ba6c2eff-a446-4a05-b7e7-8c029f9d431c">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="serial">29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="uuid">29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.config"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ef:36:e4"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <target dev="tapba6c2eff-a4"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/console.log" append="off"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:05.650876 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:05.654963 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Preparing to wait for external event network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:05.655227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:05.655453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:05.655671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:05.656601 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-1',id=14,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:05.656835 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:05.657992 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:05.657992 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:05.659061 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.659273 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:05.659504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:05.662835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.662835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0753df8-72ac-5d07-bb65-8612e64c1f15', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:05.664256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:05.674320 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.674320 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba6c2eff-a4, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:05.674599 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba6c2eff-a4, col_values=(('qos', UUID('730525ff-b2c0-43c4-bbd9-a35dd398e1fb')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:05.674836 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba6c2eff-a4, col_values=(('external_ids', {'iface-id': 'ba6c2eff-a446-4a05-b7e7-8c029f9d431c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:36:e4', 'vm-uuid': '29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:05.680395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:05.685894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.687119 np0000000747 nova-compute[97971]: INFO os_vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4')
May 14 04:27:05.697718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.703968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.742241 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:05.742241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:05.742896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:05.743979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:05.743979 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:05.743979 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:05.743979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:05.743979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:05.744352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:05.744352 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 in dict_keys([('network-vif-plugged', '12868c4f-d9e7-4d6c-80bb-07382344b782'), ('network-vif-plugged', '94f74dab-b8f0-4b58-b8e9-f291299ec4c0'), ('network-vif-plugged', '2103083d-c391-40bf-8a73-79aea110acb4'), ('network-vif-plugged', '2bdfb3b0-76cc-4c8f-8737-04b5c6682806'), ('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:05.744657 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 for instance with vm_state building and task_state spawning.
May 14 04:27:05.744745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:05.744912 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:05.745888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.746165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:05.753338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:05.753338 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:05.753338 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:05.753338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:05.753544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:05.753585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:05.753779 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 in dict_keys([('network-vif-plugged', '94f74dab-b8f0-4b58-b8e9-f291299ec4c0'), ('network-vif-plugged', '2103083d-c391-40bf-8a73-79aea110acb4'), ('network-vif-plugged', '2bdfb3b0-76cc-4c8f-8737-04b5c6682806'), ('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:05.754867 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b2dea67c-7e31-4b39-824d-3828174e9a97 req-fc30ba58-66a5-444a-819c-4665dbec8f19 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-12868c4f-d9e7-4d6c-80bb-07382344b782 for instance with vm_state building and task_state spawning.
May 14 04:27:05.754867 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:05.836540 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:05.970219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:05.978064 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732825.9759138, 4da473ba-6f29-4334-b061-1d1d34f65717 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:05.978064 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] VM Paused (Lifecycle Event)
May 14 04:27:05.997717 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:05.999341 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:06.000629 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Creating image(s)
May 14 04:27:06.002892 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.005678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.006673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.010775 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:06.010775 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:06.013666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.040284 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Booting with volume c040e303-a25c-41fa-bebc-296f7d894996 at /dev/vdb
May 14 04:27:06.085964 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:06.096423 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:06.110728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:06.111519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.111980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.112739 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:06.118655 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:06.119267 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.170806 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:06.177994 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.183601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.185589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.185808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.185967 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 in dict_keys([('network-vif-plugged', '94f74dab-b8f0-4b58-b8e9-f291299ec4c0'), ('network-vif-plugged', '2103083d-c391-40bf-8a73-79aea110acb4'), ('network-vif-plugged', '2bdfb3b0-76cc-4c8f-8737-04b5c6682806'), ('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:06.186150 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 for instance with vm_state building and task_state spawning.
May 14 04:27:06.186274 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.186413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.186538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.190994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.191832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 in dict_keys([('network-vif-plugged', '2103083d-c391-40bf-8a73-79aea110acb4'), ('network-vif-plugged', '2bdfb3b0-76cc-4c8f-8737-04b5c6682806'), ('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:06.192137 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 for instance with vm_state building and task_state spawning.
May 14 04:27:06.193082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.193082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.195795 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.195909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.196110 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:06.196300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.200060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.201331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:27:06.202505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.202724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.202950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 in dict_keys([('network-vif-plugged', '2bdfb3b0-76cc-4c8f-8737-04b5c6682806'), ('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:06.203700 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6a97d8ba-094f-4055-9c87-e12bfab63475 req-06e55789-25c2-4496-869c-3ae6f86bd8e0 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-2103083d-c391-40bf-8a73-79aea110acb4 for instance with vm_state building and task_state spawning.
May 14 04:27:06.230622 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:06.230622 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.260282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.297857 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:06.299680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk 1073741824" returned: 0 in 0.069s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:06.300501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.301210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.325814 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:06.333920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:27:06.335567 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:27:06.348916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:27:06.350398 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c'] 
May 14 04:27:06.350398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:27:06.350398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:27:06.350398 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:06.350398 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating existing volume attachment record: d2823d43-c709-46d9-9549-87639bff868a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:27:06.363505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.913s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.363505 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:06.384661 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.388540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.388861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.389103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.389354 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:06.389600 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.389780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.390066 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.390198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.390376 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No event matching network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 in dict_keys([('network-vif-plugged', 'ce562d2b-9682-4f0d-a82a-4061d061deec')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:27:06.390522 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 for instance with vm_state building and task_state spawning.
May 14 04:27:06.390699 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.391270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.391270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.391270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.391270 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Processing event network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:06.391986 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.393214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.395636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:06.397630 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.398256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.398456 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:06.398594 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received unexpected event network-vif-plugged-ce562d2b-9682-4f0d-a82a-4061d061deec for instance with vm_state building and task_state spawning.
May 14 04:27:06.398734 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:06.398900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.399070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.399222 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.399358 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c0147e8d-a9d1-48b1-a82f-596509324293 req-eba0ee74-52d6-418b-acb7-51fa7977d831 service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Processing event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:06.401925 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005914930000017193 future=<Future at 0x74361bf540e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.402673 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.403721 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Emitting event <LifecycleEvent: 1778732811.4012208, 370e3cd7-4f2f-44c5-97d6-d314825a560a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:06.403934 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.523395377000043 future=<Future at 0x7435f8567c80 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.404113 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.523166513999968 future=<Future at 0x7435f8567c80 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.404298 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.404599 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] VM Stopped (Lifecycle Event)
May 14 04:27:06.409188 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=11.280355512999904 future=<Future at 0x7435f85efc20 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.409408 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=11.280105610999954 future=<Future at 0x7435f85efc20 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:06.410340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:06.411515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:06.412035 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:06.412241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:06.438323 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance spawned successfully.
May 14 04:27:06.439304 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:06.482324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:06.495490 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732826.4942555, 4da473ba-6f29-4334-b061-1d1d34f65717 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:06.495490 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] VM Resumed (Lifecycle Event)
May 14 04:27:06.537106 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:06.550404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:06.551362 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Cannot resize image /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:06.551959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:06.552048 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Ensure instance console log exists: /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:06.552660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:06.552720 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:06.552906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:06.562915 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:06.571172 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:06.582178 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance spawned successfully.
May 14 04:27:06.582631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:06.604673 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:06.760495 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updated VIF entry in instance network info cache for port ba6c2eff-a446-4a05-b7e7-8c029f9d431c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:06.764535 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating instance_info_cache with network_info: [{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:06.893028 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:06.893163 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:06.893387 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:06.894386 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:06.913633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 370e3cd7-4f2f-44c5-97d6-d314825a560a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:06.959644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.001848 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:07.005901 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:07.099008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.099008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.099008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.099224 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.101370 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.101857 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:07.111772 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Took 2.39 seconds to deallocate network for instance.
May 14 04:27:07.137858 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7778c84ee3f3406999f838e5009483a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781e2f73cfe2496391efde04eee02a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:07.226920 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:07.227247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:07.228979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No VIF found with MAC fa:16:3e:ef:36:e4, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:07.230115 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Using config drive
May 14 04:27:07.267412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0a059e5d-c1ed-4012-b606-8c10f1c32d1f req-7a2033d6-5b91-40e1-ad91-44702bef57cf service nova] Releasing lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:07.398269 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:07.460712 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Successfully updated port: 08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:07.475685 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Took 38.50 seconds to spawn the instance on the hypervisor.
May 14 04:27:07.477730 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:07.512236 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:07.514885 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732827.5145624, 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:07.515085 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] VM Started (Lifecycle Event)
May 14 04:27:07.618247 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Took 8.89 seconds to spawn the instance on the hypervisor.
May 14 04:27:07.618442 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:07.752172 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:07.808955 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Took 0.68 seconds to detach 1 volumes for instance.
May 14 04:27:07.911465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:07.977377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:07.977481 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquired lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:07.978365 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:08.000364 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Took 50.74 seconds to build instance.
May 14 04:27:08.019402 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:08.027425 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:08.065371 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Creating config drive at /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.config
May 14 04:27:08.074188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv061n00m {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:08.142590 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv061n00m" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:08.146138 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Took 14.60 seconds to build instance.
May 14 04:27:08.174861 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Successfully created port: 7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:08.267312 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fad7f7c8-873f-402c-8b13-1e3623d962b5 req-86fe0e4d-ca3c-4926-9a20-9632f5c9de6c service nova] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Received event network-vif-deleted-5088963d-83e8-4f8a-afab-b4d7c1a9b5c5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:08.325392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.325392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.329649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.393374 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Deleted allocations for instance 46c1f391-bb33-4215-9e23-0d7999c5fc87
May 14 04:27:08.508796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-140463dc-5243-41b6-9795-dbf0f7b417e4 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.276s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.520190 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:08.520190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.520694 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.520694 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.521670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:08.521670 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received unexpected event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with vm_state active and task_state None.
May 14 04:27:08.521670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:08.524396 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.524396 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.527539 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.527539 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:08.527539 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received unexpected event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with vm_state building and task_state spawning.
May 14 04:27:08.527539 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:08.528503 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing instance network info cache due to event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:08.528503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Acquiring lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:08.533510 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732828.5331147, 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:08.533756 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] VM Paused (Lifecycle Event)
May 14 04:27:08.641701 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:08.653328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4c665a39-9b1d-4a78-9524-b13d3be1482a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.124s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.689197 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:08.689197 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating image(s)
May 14 04:27:08.689197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.689197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.689197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.689718 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fabeeab597473753801a99ac0723920e5c247af1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.689718 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fabeeab597473753801a99ac0723920e5c247af1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.794405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:08.836888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:08.931500 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:08.932535 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:08.933249 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Creating image(s)
May 14 04:27:08.933249 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:08.933449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:08.938656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:08.939343 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:08.947536 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:08.952744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.023096 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:09.041938 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:09.054492 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732829.0540955, 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:09.054689 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] VM Resumed (Lifecycle Event)
May 14 04:27:09.066562 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:09.135202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.180s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.135202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:09.135680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:09.136204 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:09.141798 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:09.144007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.187692 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Successfully updated port: 7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:09.299975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.157s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.300811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.414028 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5caf06f-118e-45fc-bf52-8729b805844d tempest-ServerActionsTestOtherB-1774572299 tempest-ServerActionsTestOtherB-1774572299-project-member] Lock "46c1f391-bb33-4215-9e23-0d7999c5fc87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.126s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:09.418462 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk 1073741824" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.419672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:09.420126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.436273 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:09.476657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:09.550709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.129s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.553254 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:09.555382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.574417 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:09.582213 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:09.613808 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:09.614263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 04:27:09.662853 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:09.680983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.687898 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Cannot resize image /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:09.687898 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:09.688079 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Ensure instance console log exists: /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:09.688916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:09.689248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:09.689574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:09.693709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:09.693709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:09.693709 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:09.812967 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:09.816475 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:09.818355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:09.941876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.part --force-share --output=json" returned: 0 in 0.124s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:09.942762 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] c33366ff-2bc7-427b-a9a0-922bc7fdbf13 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:27:09.944001 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:27:09.944353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.part /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.122981 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] There are 0 instances to clean {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 04:27:10.122981 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:10.122981 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 04:27:10.178059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Releasing lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:10.178059 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Instance network_info: |[{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:10.178059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Acquired lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:10.178059 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:10.179366 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Start _get_guest_xml network_info=[{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:10.184631 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:10.186343 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-443863854-2', uuid='34b571d5-617e-4f48-8368-7bb5fc36bfa2'), owner=OwnerMeta(userid='e6f5bedbcf3d461b89449de1f1ed3f71', username='tempest-TestMultiAttachVolumeSwap-1644439510-project-member', projectid='d09c55a931624a709a3721d199eecd5f', projectname='tempest-TestMultiAttachVolumeSwap-1644439510'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732830.1858459) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:10.187446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:10.187961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:10.191636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:10.192129 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:10.194022 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:10.196961 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:10.197224 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:10.197728 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:10.197965 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:10.198154 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:10.199587 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:10.201662 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:10.203009 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:10.203320 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:10.203857 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:10.204157 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:10.219553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.part /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.converted" returned: 0 in 0.275s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.226459 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-2',id=15,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=34b571d5-617e-4f48-8368-7bb5fc36bfa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:10.228887 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:10.230941 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:10.230941 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:10.237092 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732830.2366924, 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:10.239125 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] VM Started (Lifecycle Event)
May 14 04:27:10.241384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.350657 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:10.387206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.387969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fabeeab597473753801a99ac0723920e5c247af1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:10.389528 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:10.402402 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:10.410695 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-changed-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:10.410695 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing instance network info cache due to event network-changed-7928820e-0ad1-4a1b-900d-f0be8b0b4298. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:10.410695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:10.411949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.526776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.527459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fabeeab597473753801a99ac0723920e5c247af1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:10.528365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fabeeab597473753801a99ac0723920e5c247af1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:10.529669 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:10.538189 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:10.543180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.629526 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:10.676014 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.679814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json" returned: 0 in 0.141s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.680504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1,backing_fmt=raw /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.709459 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:10.742309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <uuid>34b571d5-617e-4f48-8368-7bb5fc36bfa2</uuid>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <name>instance-0000000f</name>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-443863854-2</nova:name>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:10</nova:creationTime>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:user uuid="e6f5bedbcf3d461b89449de1f1ed3f71">tempest-TestMultiAttachVolumeSwap-1644439510-project-member</nova:user>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:project uuid="d09c55a931624a709a3721d199eecd5f">tempest-TestMultiAttachVolumeSwap-1644439510</nova:project>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         <nova:port uuid="08d656ba-4789-4687-9c3a-eaaf2593b3dd">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="serial">34b571d5-617e-4f48-8368-7bb5fc36bfa2</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="uuid">34b571d5-617e-4f48-8368-7bb5fc36bfa2</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.config"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:29:1f:8c"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <target dev="tap08d656ba-47"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/console.log" append="off"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:10.742309 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:10.748714 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Preparing to wait for external event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:10.748714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:10.748714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:10.748714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:10.750474 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-2',id=15,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=34b571d5-617e-4f48-8368-7bb5fc36bfa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:10.750835 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:10.751707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1,backing_fmt=raw /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk 1073741824" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.752315 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:10.752315 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:10.753453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fabeeab597473753801a99ac0723920e5c247af1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:10.754163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.761029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:10.761029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:10.761029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:10.797547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:10.798048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.800095 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1af4ace6-01c6-5549-aa13-9f01da32082b', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:10.804340 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732830.8012044, 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:10.804672 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] VM Paused (Lifecycle Event)
May 14 04:27:10.811514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:10.822035 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:10.826139 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.827159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d656ba-47, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:10.830243 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08d656ba-47, col_values=(('qos', UUID('2a945dd0-3481-468d-9396-817fba088adb')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:10.832718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08d656ba-47, col_values=(('external_ids', {'iface-id': '08d656ba-4789-4687-9c3a-eaaf2593b3dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:1f:8c', 'vm-uuid': '34b571d5-617e-4f48-8368-7bb5fc36bfa2'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:10.834948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.836952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:10.841954 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:10.843065 np0000000747 nova-compute[97971]: INFO os_vif [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47')
May 14 04:27:10.913315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fabeeab597473753801a99ac0723920e5c247af1 --force-share --output=json" returned: 0 in 0.159s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:10.914221 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:10.914770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:11.015564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:11.016356 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Cannot resize image /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:11.016928 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:11.017207 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:11.017859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:11.017993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:11.018172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:11.022376 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start _get_guest_xml network_info=[{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T04:22:30Z,direct_url=<?>,disk_format='qcow2',id=c33366ff-2bc7-427b-a9a0-922bc7fdbf13,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T04:22:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd2823d43-c709-46d9-9549-87639bff868a', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'eb9bb511-c615-4ea8-9fa3-c784c88a680d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'serial': 'c040e303-a25c-41fa-bebc-296f7d894996'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:11.030382 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 14 04:27:11.031992 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='c33366ff-2bc7-427b-a9a0-922bc7fdbf13', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-330518108', uuid='eb9bb511-c615-4ea8-9fa3-c784c88a680d'), owner=OwnerMeta(userid='5a8ede1ead104b17957a4b8b20b80d6b', username='tempest-ServerActionsTestOtherA-1166153365-project-member', projectid='c6680b6e8f4e4852b7d9bb1f67e84fe6', projectname='tempest-ServerActionsTestOtherA-1166153365'), image=ImageMeta(id='c33366ff-2bc7-427b-a9a0-922bc7fdbf13', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732831.0315037) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:11.033941 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:11.033941 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:11.034072 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:11.034290 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:11.035517 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:11.035959 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T04:22:30Z,direct_url=<?>,disk_format='qcow2',id=c33366ff-2bc7-427b-a9a0-922bc7fdbf13,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T04:22:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:11.036142 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:11.036282 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:11.036433 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:11.036556 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:11.036817 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:11.036914 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:11.037049 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:11.037199 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:11.037334 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:11.037498 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:11.037717 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:11.059493 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:11.104013 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-changed-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:11.104491 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing instance network info cache due to event network-changed-0b752b51-9720-4646-9cc2-bf7aa483b3a0. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:11.104491 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] Acquiring lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:11.107658 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] Acquired lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:11.108368 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Refreshing network info cache for port 0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:11.138456 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:27:11.240642 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:11.320584 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:11.326672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:11.496936 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updated VIF entry in instance network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:11.498708 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:11.563748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:27:11.563748 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:11.563748 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:11.563748 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:11.563748 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:27:11.572864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:11.573856 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Instance network_info: |[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:11.573856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:11.574073 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing network info cache for port 7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:11.577280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Start _get_guest_xml network_info=[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:11.582679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:11.582894 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:11.584818 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1159631461', uuid='c249f70f-670b-4f62-adad-6093dc284b23'), owner=OwnerMeta(userid='7778c84ee3f3406999f838e5009483a3', username='tempest-TaggedAttachmentsTest-1756793520-project-member', projectid='781e2f73cfe2496391efde04eee02a9e', projectname='tempest-TaggedAttachmentsTest-1756793520'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732831.5839822) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:11.586258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:11.587092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:11.587169 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:27:11.587556 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:11.587801 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:27:11.590316 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:11.591378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:11.591871 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:11.592339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:11.593408 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:11.594974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:11.595276 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:11.595276 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:11.595381 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:11.597601 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:11.609490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:27:11.609490 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:11.610051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:27:11.610051 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:11.620465 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:11.633658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996] added
May 14 04:27:11.633658 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:27:11.633658 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:11.633658 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:11.633658 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:11.633658 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:11.633658 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0468(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996] added
May 14 04:27:11.635712 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:11.635712 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:27:11.635712 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0478(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:27:11.637567 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:27:11.646647 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:11.646647 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:11.647689 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:11.648528 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'pci_devices' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:11.834634 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:12.002364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b8ba48a-32d8-42e3-bd64-084f28625f56 req-2caf6e73-552d-445e-bb3c-9775b98e3691 service nova] Releasing lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:12.079693 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:12.125256 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:12.153345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <uuid>c249f70f-670b-4f62-adad-6093dc284b23</uuid>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <name>instance-00000010</name>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:11</nova:creationTime>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="serial">c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="uuid">c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:a5:f7:19"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <target dev="tap7928820e-0a"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log" append="off"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:12.153345 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:12.158551 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Preparing to wait for external event network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:12.158551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:12.158551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:12.158551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:12.158551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:12.161981 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:12.162192 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:12.165164 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:12.165863 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.166221 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:12.166514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:12.169172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.170247 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e21f6cb9-2ca9-543a-9d2f-d87784fecf21', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:12.171750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.174626 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:12.180149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.183447 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.183611 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7928820e-0a, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:12.184794 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7928820e-0a, col_values=(('qos', UUID('956802f6-8f17-4f54-b154-7cd7e4631ec8')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:12.186648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7928820e-0a, col_values=(('external_ids', {'iface-id': '7928820e-0ad1-4a1b-900d-f0be8b0b4298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f7:19', 'vm-uuid': 'c249f70f-670b-4f62-adad-6093dc284b23'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:12.187130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.188297 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:12.202023 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:12.202023 np0000000747 nova-compute[97971]: INFO os_vif [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a')
May 14 04:27:12.339810 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updated VIF entry in instance network info cache for port 0b752b51-9720-4646-9cc2-bf7aa483b3a0. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:12.343149 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:12.383053 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:12.383226 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:12.383340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No VIF found with MAC fa:16:3e:29:1f:8c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:12.383786 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Using config drive
May 14 04:27:12.532538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:12.532827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:12.541012 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:12.541127 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing instance network info cache due to event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:12.541345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] Acquiring lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:12.541461 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] Acquired lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:12.541590 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing network info cache for port c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:12.608260 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:12.636091 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:27:12.639522 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:12.653782 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:12.653782 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:12.668679 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:12.668679 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.675398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.696192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.704953 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.723977 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:12.777631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260]
May 14 04:27:12.777631 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260] successful.
May 14 04:27:12.777631 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.793536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260]
May 14 04:27:12.793536 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260] successful.
May 14 04:27:12.793536 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.798701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.808898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.833824 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.247s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:12.833824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:12.838109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('15', '-', '-', 0) found on session 34 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:12.838244 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.846927 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00667215-1a02-48ad-9e56-629366a6f292 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:12.849503 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab0fe99b-1738-472a-863f-cf1dcb300850 req-00d8fc79-fb84-4584-b623-a165cc7414a6 service nova] Releasing lock "refresh_cache-4da473ba-6f29-4334-b061-1d1d34f65717" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:12.849503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:12.851654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('16', '-', '-', 0) found on session 35 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:12.851654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:12.871115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 34 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:12.871115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:12.887547 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updated VIF entry in instance network info cache for port 7928820e-0ad1-4a1b-900d-f0be8b0b4298. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:12.887547 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:12.903191 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:12.907877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 35 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:12.907877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:13.046760 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:27:13.053786 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:13.096228 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Creating config drive at /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.config
May 14 04:27:13.104565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wvu1i5t {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:13.128887 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:13.135643 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:13.135643 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:13.135643 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.47 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:27:13.162080 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wvu1i5t" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Processing event network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] No waiting events found dispatching network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:13.391121 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c709035d-2fea-4c8d-a62d-abff1ab78fe0 req-9e7aede6-0a4e-483d-8f9d-06b8cf3c7aca service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received unexpected event network-vif-plugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c for instance with vm_state building and task_state spawning.
May 14 04:27:13.392435 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:13.399895 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732833.3994644, 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:13.400074 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] VM Resumed (Lifecycle Event)
May 14 04:27:13.401953 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:13.404978 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Instance spawned successfully.
May 14 04:27:13.405413 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:13.538968 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:13.598820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:27:13.611434 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:13.612269 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:13.612269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:27:13.612400 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:27:13.684300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:13.684769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:13.693032 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:27:13.693032 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Claim successful on node np0000000747
May 14 04:27:13.746720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:13.747100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:13.747373 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No VIF found with MAC fa:16:3e:a5:f7:19, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:13.748135 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Using config drive
May 14 04:27:13.771133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:13.796178 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:13.821100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:13.874176 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updated VIF entry in instance network info cache for port c8645ad6-8a83-4f7b-8466-37d93e660471. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:13.877115 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:13.906859 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:13.923299 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:13.927932 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.927932 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.930916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.930916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.930916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.933515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:13.940980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:14.037485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:14.043301 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:14.222790 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e0e6fe15-45c4-4bf8-bdff-3c85015e8457 req-5177d6b6-84bd-467f-a5ce-244560f1f1f3 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:14.225546 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e0e6fe15-45c4-4bf8-bdff-3c85015e8457 req-5177d6b6-84bd-467f-a5ce-244560f1f1f3 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:14.225971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e0e6fe15-45c4-4bf8-bdff-3c85015e8457 req-5177d6b6-84bd-467f-a5ce-244560f1f1f3 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:14.226274 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e0e6fe15-45c4-4bf8-bdff-3c85015e8457 req-5177d6b6-84bd-467f-a5ce-244560f1f1f3 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:14.226571 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e0e6fe15-45c4-4bf8-bdff-3c85015e8457 req-5177d6b6-84bd-467f-a5ce-244560f1f1f3 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Processing event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:14.270376 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:14.383258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2015a837-34ae-4ba8-b380-cd80cb0269c6 req-9dc5b430-0a93-4a11-a6fa-79964706ab5c service nova] Releasing lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:14.426171 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:14.449305 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Took 11.21 seconds to spawn the instance on the hypervisor.
May 14 04:27:14.449543 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:14.611401 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:14.644795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found WWN 3300000001b61f96e for multipath device dm-8 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:27:14.644795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.081s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:14.647976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== connect_volume: return (3081ms) {'type': 'block', 'scsi_wwn': '3300000001b61f96e', 'path': '/dev/dm-8', 'multipath_id': '3300000001b61f96e'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:14.648317 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001b61f96e', 'path': '/dev/dm-8', 'multipath_id': '3300000001b61f96e'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:27:14.746707 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Creating config drive at /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config
May 14 04:27:14.758174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpig76buww {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:14.832422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpig76buww" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:14.977245 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Took 19.71 seconds to build instance.
May 14 04:27:15.120757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:15.173279 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-ServerActionsTestOtherA-server-330518108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:00Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:15.173279 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:15.174827 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:15.179018 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <uuid>eb9bb511-c615-4ea8-9fa3-c784c88a680d</uuid>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <name>instance-00000008</name>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherA-server-330518108</nova:name>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:11</nova:creationTime>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:image uuid="c33366ff-2bc7-427b-a9a0-922bc7fdbf13">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:user uuid="5a8ede1ead104b17957a4b8b20b80d6b">tempest-ServerActionsTestOtherA-1166153365-project-member</nova:user>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:project uuid="c6680b6e8f4e4852b7d9bb1f67e84fe6">tempest-ServerActionsTestOtherA-1166153365</nova:project>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="c33366ff-2bc7-427b-a9a0-922bc7fdbf13"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         <nova:port uuid="d14b0b96-59d7-4fb2-8b83-fb72d95bd884">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="serial">eb9bb511-c615-4ea8-9fa3-c784c88a680d</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="uuid">eb9bb511-c615-4ea8-9fa3-c784c88a680d</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <alias name="ua-c040e303-a25c-41fa-bebc-296f7d894996"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-8"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <serial>c040e303-a25c-41fa-bebc-296f7d894996</serial>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:fb:39:88"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <target dev="tapd14b0b96-59"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/console.log" append="off"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:15.179018 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:15.182376 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-ServerActionsTestOtherA-server-330518108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:00Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:15.182376 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:15.189526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.193347 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '315d941c-809d-560a-b1ac-8261a0070661', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:15.195486 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.195486 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:15.203484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.211918 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.212155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd14b0b96-59, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:15.212597 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd14b0b96-59, col_values=(('qos', UUID('20ccf50b-1e3b-41a7-bb24-fa29ef2b2ae9')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:15.212839 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd14b0b96-59, col_values=(('external_ids', {'iface-id': 'd14b0b96-59d7-4fb2-8b83-fb72d95bd884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:39:88', 'vm-uuid': 'eb9bb511-c615-4ea8-9fa3-c784c88a680d'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:15.215136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.216948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:15.241490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.244780 np0000000747 nova-compute[97971]: INFO os_vif [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59')
May 14 04:27:15.312526 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732835.3119822, 34b571d5-617e-4f48-8368-7bb5fc36bfa2 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:15.314272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:15.314272 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] VM Started (Lifecycle Event)
May 14 04:27:15.317456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:15.336738 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Instance spawned successfully.
May 14 04:27:15.337646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:15.483842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.219s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:15.666692 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.712438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.768108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:15.824382 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:15.834962 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:15.859904 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.860130 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.860584 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.860970 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.861332 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.864756 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:15.967489 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:15.967843 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:16.017050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.128174 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dffa7139-6417-43d6-bb20-6a5b8f508b2f req-93a383b0-d4b8-4081-87dd-3524fd0a4cb4 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:16.128325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dffa7139-6417-43d6-bb20-6a5b8f508b2f req-93a383b0-d4b8-4081-87dd-3524fd0a4cb4 service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:16.128573 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dffa7139-6417-43d6-bb20-6a5b8f508b2f req-93a383b0-d4b8-4081-87dd-3524fd0a4cb4 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:16.128700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dffa7139-6417-43d6-bb20-6a5b8f508b2f req-93a383b0-d4b8-4081-87dd-3524fd0a4cb4 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:16.128845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dffa7139-6417-43d6-bb20-6a5b8f508b2f req-93a383b0-d4b8-4081-87dd-3524fd0a4cb4 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Processing event network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:16.337502 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.337815 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:16.338437 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732836.3380275, 34b571d5-617e-4f48-8368-7bb5fc36bfa2 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:16.338690 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] VM Paused (Lifecycle Event)
May 14 04:27:16.340285 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.350048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.377656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.378470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:16.380362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:16.380896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:16.381056 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:16.381175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:16.381660 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:16.381660 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-03e86976-5ad1-407f-8af7-5f0c0356d869 req-a94407c8-6e42-44ce-a101-08743476c960 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received unexpected event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with vm_state building and task_state spawning.
May 14 04:27:16.390890 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Took 10.39 seconds to spawn the instance on the hypervisor.
May 14 04:27:16.391662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:16.472163 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:16.798843 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:16.802153 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:16.802153 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:16.802251 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:fb:39:88, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:16.802787 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Using config drive
May 14 04:27:16.842374 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:16.845923 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732836.8455498, 34b571d5-617e-4f48-8368-7bb5fc36bfa2 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:16.845923 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] VM Resumed (Lifecycle Event)
May 14 04:27:16.910549 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Took 21.58 seconds to build instance.
May 14 04:27:16.996429 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.312s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:16.998967 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:17.001565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.878s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:17.003000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:17.003203 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:27:17.310069 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'ec2_ids' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:17.312822 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:17.317821 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:17.328698 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Instance spawned successfully.
May 14 04:27:17.329006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:17.352127 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:17.366444 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:17.412818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-833fea40-5e3d-439c-8608-6b64b2b84ae3 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.094s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:17.512059 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:17.512236 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:17.512494 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:17.512861 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:17.690164 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00036990000012337987 future=<Future at 0x7435f85efc20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.690485 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Emitting event <LifecycleEvent: 1778732822.6894126, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:17.690706 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.690848 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.00014567299990631 future=<Future at 0x74361824b0e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.690930 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.940400001236412e-05 future=<Future at 0x74361824b0e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.691790 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Stopped (Lifecycle Event)
May 14 04:27:17.696006 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.004804641000191623 future=<Future at 0x74361824b0e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.696006 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:17.696398 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Emitting event <LifecycleEvent: 1778732822.6909494, 46c1f391-bb33-4215-9e23-0d7999c5fc87 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:17.696634 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] VM Stopped (Lifecycle Event)
May 14 04:27:17.726416 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:17.819304 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Object Instance<eb9bb511-c615-4ea8-9fa3-c784c88a680d> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:17.820361 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'keypairs' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:17.844672 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.846763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.848679 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.848679 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.851206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.852108 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:17.877326 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732837.8769634, c249f70f-670b-4f62-adad-6093dc284b23 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:17.877741 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] VM Started (Lifecycle Event)
May 14 04:27:18.019724 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:18.093872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:18.203282 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 46c1f391-bb33-4215-9e23-0d7999c5fc87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:18.208104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:18.215079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:18.279666 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:18.280528 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:18.281159 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:18.281964 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:18.284369 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:18.284487 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5c354780-4f09-4347-8363-7dab46af5dea req-13b27165-9d35-4ac2-8863-2511b4d8c5ec service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received unexpected event network-vif-plugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 for instance with vm_state building and task_state spawning.
May 14 04:27:18.309551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:18.311721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:18.342112 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Object Instance<eb9bb511-c615-4ea8-9fa3-c784c88a680d> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:18.350019 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 14 04:27:18.368063 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Took 9.44 seconds to spawn the instance on the hypervisor.
May 14 04:27:18.375441 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:18.394531 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:18.400113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:18.502870 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:18.510727 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:18.519193 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:18.519335 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:18.519422 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:18.522860 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:18.523308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:18.650566 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:18.651599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:18.721804 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e30af2bd-7b47-4dab-8761-c26c45c59ae6 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 14 04:27:18.802962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:18.808715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:18.903479 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:18.904567 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Took 19.66 seconds to build instance.
May 14 04:27:18.907024 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732838.905374, c249f70f-670b-4f62-adad-6093dc284b23 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:18.907024 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] VM Paused (Lifecycle Event)
May 14 04:27:18.946018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:18.946533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.027246 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Successfully created port: e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:19.090669 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.091167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:19.091493 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000008, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config'
May 14 04:27:19.098800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.167006 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Creating config drive at /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config
May 14 04:27:19.185899 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr3vk_vkx {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.244864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.245492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.272440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr3vk_vkx" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.357736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.368704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.410276 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-76803bd6-f85f-4b88-b0a6-5fcac9210b42 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.184s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:19.420701 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:19.428100 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732839.4276893, c249f70f-670b-4f62-adad-6093dc284b23 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:19.428305 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] VM Resumed (Lifecycle Event)
May 14 04:27:19.480248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.481423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.585254 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:19.589201 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:19.589453 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Creating image(s)
May 14 04:27:19.593251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.593580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:19.594553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:19.594553 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:27:19.595168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:19.595476 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:19.601185 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:19.605806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.638660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.757168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.760678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.786668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.179s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.790647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:19.790647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:19.801640 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:19.811983 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:19.813498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.942593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:19.942593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.129s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.946599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:19.988932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:19.994814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:20.012924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:20.038562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk 1073741824" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.041413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:20.041714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:20.216744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.224023 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.271478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.230s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.274580 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.276174 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:20.278413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:20.325746 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.327180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:20.327958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.421279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.423681 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:20.423838 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:20.425508 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Ensure instance console log exists: /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:20.425508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:20.425508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:20.425508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:20.468782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.470755 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.520419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.532693 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:20.534286 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:20.568701 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Successfully updated port: e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:20.572153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:20.600257 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:20.600478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing instance network info cache due to event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:20.602753 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] Acquiring lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:20.602824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] Acquired lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:20.603013 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:20.606201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:20.611005 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12878MB free_disk=73.6818618774414GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:27:20.611005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:20.611005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:20.681217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:20.682058 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing instance network info cache due to event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:20.682373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] Acquiring lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:20.682491 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] Acquired lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:20.682672 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing network info cache for port e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:20.776130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:21.077179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:21.107314 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:21.188819 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:21.311476 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:21.538517 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:21.676533 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:21.731514 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.733657 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.735075 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance eb9bb511-c615-4ea8-9fa3-c784c88a680d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.735244 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4da473ba-6f29-4334-b061-1d1d34f65717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.735350 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.735692 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.737168 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.737497 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.737626 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance c249f70f-670b-4f62-adad-6093dc284b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.737732 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5d42ebce-6d76-4893-b335-bceb7181a83a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:27:21.738005 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:27:21.738143 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:27:20 up 27 min,  2 users,  load average: 10.41, 4.80, 2.19\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_c6680b6e8f4e4852b7d9bb1f67e84fe6': '2', 'io_workload': '1', 'num_proj_2d49cec32e7e4e59ab41cd04147db756': '1', 'num_task_rebuild_spawning': '1', 'num_proj_93dd24bcdb5043d9b23426bea16778cb': '1', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '3', 'num_proj_d09c55a931624a709a3721d199eecd5f': '2', 'num_proj_781e2f73cfe2496391efde04eee02a9e': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:27:21.861187 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:21.866647 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732841.863765, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:21.866647 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Resumed (Lifecycle Event)
May 14 04:27:21.866647 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:21.874448 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance spawned successfully.
May 14 04:27:21.874949 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:22.030988 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updated VIF entry in instance network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:22.032505 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:22.044150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d672c65a-f0e0-4d2d-a685-3869c815640f req-bd57e7fa-cc79-411c-8430-a2e9d77fb5af service nova] Releasing lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:22.044989 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:22.045187 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:22.225655 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:22.370568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:22.372047 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:22.384752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.384752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.385339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.385339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.385546 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.385920 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:22.534813 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-873e0bf1-10c2-4bcf-8f43-4697afed82c5 req-20bdd1f2-f4f6-4a9a-abea-9a84bb505329 service nova] Releasing lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:22.570664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:22.571450 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:22.712923 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:22.731696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-changed-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:22.731696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing instance network info cache due to event network-changed-7928820e-0ad1-4a1b-900d-f0be8b0b4298. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:22.731696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:22.731696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:22.731959 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing network info cache for port 7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:22.875113 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 14 04:27:22.875448 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732842.8751974, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:22.875538 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Started (Lifecycle Event)
May 14 04:27:22.895445 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:23.052826 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:23.075797 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:23.235149 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:23.379818 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:23.384806 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:23.414040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:23.430440 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:23.586576 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:27:23.586869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.977s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:23.588114 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:27:23.593537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.177s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:23.593537 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97971) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 14 04:27:23.866947 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:23.935224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:23.935705 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance network_info: |[{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:23.938184 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Start _get_guest_xml network_info=[{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:23.941118 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:23.942767 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='5d42ebce-6d76-4893-b335-bceb7181a83a'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732843.9422388) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:23.947401 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:23.951185 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:23.952761 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:23.953092 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:23.954866 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:23.956877 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:23.957495 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:23.957495 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:23.961311 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:23.961311 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:23.961726 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:23.961726 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:23.961957 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:23.962218 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:23.962218 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:23.962311 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:24.019813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=17,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-c0cmilx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=5d42ebce-6d76-4893-b335-bceb7181a83a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:24.020094 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:24.022532 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:24.023652 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:24.113464 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updated VIF entry in instance network info cache for port 7928820e-0ad1-4a1b-900d-f0be8b0b4298. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:24.114965 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:24.481983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.527040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <uuid>5d42ebce-6d76-4893-b335-bceb7181a83a</uuid>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <name>instance-00000011</name>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-1</nova:name>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:23</nova:creationTime>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         <nova:port uuid="e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="serial">5d42ebce-6d76-4893-b335-bceb7181a83a</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="uuid">5d42ebce-6d76-4893-b335-bceb7181a83a</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.config"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:12:28:b5"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <target dev="tape4e8226a-fe"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/console.log" append="off"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:24.527040 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Preparing to wait for external event network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=17,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-c0cmilx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=5d42ebce-6d76-4893-b335-bceb7181a83a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:24.529607 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:24.530257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.530296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:24.530853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:24.532981 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.533280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c85d492f-f7ae-55ce-8991-3b65e13b4db5', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:24.536804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.537977 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:24.543365 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.543632 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e8226a-fe, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:24.543976 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4e8226a-fe, col_values=(('qos', UUID('fece2afb-31b7-48a9-bcc5-1a0ddfae71da')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:24.544129 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4e8226a-fe, col_values=(('external_ids', {'iface-id': 'e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:28:b5', 'vm-uuid': '5d42ebce-6d76-4893-b335-bceb7181a83a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:24.544967 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.550693 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:24.553904 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:24.555191 np0000000747 nova-compute[97971]: INFO os_vif [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe')
May 14 04:27:24.588044 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:24.590814 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:27:24.591146 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:27:24.612230 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7434900e-1b8b-4cf3-a5ef-9911a8448d06 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.020s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received unexpected event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with vm_state active and task_state rebuild_spawning.
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:24.618124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:24.621323 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:24.621323 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-91eaa3d9-69f6-4855-a1fc-00fde7ca2028 req-27f7739f-134e-4b12-ab9b-14d3713080e9 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received unexpected event network-vif-plugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with vm_state active and task_state rebuild_spawning.
May 14 04:27:24.681899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:25.781507 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:26.083699 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:26.083699 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:26.083699 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:12:28:b5, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:26.083699 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Using config drive
May 14 04:27:26.588751 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:26.693210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:26.693210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:26.766296 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Creating config drive at /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.config
May 14 04:27:26.770909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplu3lc4qj {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:26.836556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplu3lc4qj" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:27.195179 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:27:27.357947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.396068 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.403172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.482945 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.544919 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.547472 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:27.652092 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce7f6aec-0faf-40ae-98b0-60fbb8288f7a req-cb9eb84c-8a36-40fe-bad2-1de4553741c8 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:27.653262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce7f6aec-0faf-40ae-98b0-60fbb8288f7a req-cb9eb84c-8a36-40fe-bad2-1de4553741c8 service nova] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:27.653262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce7f6aec-0faf-40ae-98b0-60fbb8288f7a req-cb9eb84c-8a36-40fe-bad2-1de4553741c8 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:27.654197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce7f6aec-0faf-40ae-98b0-60fbb8288f7a req-cb9eb84c-8a36-40fe-bad2-1de4553741c8 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:27.654197 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce7f6aec-0faf-40ae-98b0-60fbb8288f7a req-cb9eb84c-8a36-40fe-bad2-1de4553741c8 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Processing event network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:27.662672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:27.664483 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:27.886034 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:27.887193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:27.891868 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:27:27.892254 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Claim successful on node np0000000747
May 14 04:27:28.166208 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:27:28.414057 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:28.414643 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732848.4142587, 5d42ebce-6d76-4893-b335-bceb7181a83a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:28.414874 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] VM Started (Lifecycle Event)
May 14 04:27:28.418827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:28.423266 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance spawned successfully.
May 14 04:27:28.427050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:28.732643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:28.923761 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:28.926679 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:28.951310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:28.951888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:28.953682 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:28.955557 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:28.957173 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:28.958945 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:29.003156 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Refreshing inventories for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 04:27:29.087384 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Updating ProviderTree inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 04:27:29.087591 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:27:29.165212 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Refreshing aggregate associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, aggregates: None {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 04:27:29.247763 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Refreshing trait associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, traits: COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_SOUND_MODEL_PCSPK,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 04:27:29.446106 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:29.446106 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732849.4437063, 5d42ebce-6d76-4893-b335-bceb7181a83a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:29.446106 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] VM Paused (Lifecycle Event)
May 14 04:27:29.478992 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Took 9.89 seconds to spawn the instance on the hypervisor.
May 14 04:27:29.479442 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:29.547549 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:29.752194 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:29.752897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:29.753880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:29.754115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:29.754346 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] No waiting events found dispatching network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:29.754585 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c5e43798-8fe3-4456-9c8c-4e5931e1fca3 req-76a7a355-e3b3-463f-9957-db3987c05c9b service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received unexpected event network-vif-plugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 for instance with vm_state active and task_state None.
May 14 04:27:29.947903 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:29.951694 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732849.9504426, 5d42ebce-6d76-4893-b335-bceb7181a83a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:29.951694 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] VM Resumed (Lifecycle Event)
May 14 04:27:30.005922 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Took 16.43 seconds to build instance.
May 14 04:27:30.037759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:30.038238 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:30.454297 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:30.462118 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:30.513653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4b04eb-34af-44a8-bcfa-09a96fa4d575 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.979s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:30.543069 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:30.785827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:31.061875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.173s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:31.061875 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:31.069954 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.338s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:31.076925 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:27:31.077099 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Claim successful on node np0000000747
May 14 04:27:31.570094 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:31.571950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing instance network info cache due to event network-changed-c8645ad6-8a83-4f7b-8466-37d93e660471. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:31.571950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] Acquiring lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:31.571950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] Acquired lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:31.572234 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Refreshing network info cache for port c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:31.582509 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:31.583681 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:31.584013 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:31.584515 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:31.726959 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79086847c5a343519481b0a50930103f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaef82fed39403a80c7ec4baa8ad091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:32.083503 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:32.093986 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:32.566280 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Successfully created port: f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:32.606645 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:32.759878 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:33.011211 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updated VIF entry in instance network info cache for port c8645ad6-8a83-4f7b-8466-37d93e660471. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:33.015064 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [{"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:33.207759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:33.208163 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:33.394378 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Successfully updated port: f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:33.480658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-changed-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:33.480814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Refreshing instance network info cache due to event network-changed-f9b6dc47-4e62-4b75-845e-2b20f0e068fb. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:33.480992 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] Acquiring lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:33.481111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] Acquired lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:33.481292 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Refreshing network info cache for port f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:33.517262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca843058-1a59-4943-a023-2283727899e6 req-8f79a5e6-66d5-4a3f-8d5f-8b8d859292bf service nova] Releasing lock "refresh_cache-9ab87dcf-3d40-4cfe-812d-bc19d06f3270" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:33.621960 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:33.622911 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:33.623127 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Creating image(s)
May 14 04:27:33.623577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:33.623735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:33.631324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:33.631985 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:33.639422 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:33.645892 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:33.646108 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing instance network info cache due to event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:33.646320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] Acquiring lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:33.646508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] Acquired lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:33.646628 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing network info cache for port e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:33.648225 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:33.691488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:33.691888 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:33.715172 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:33.737010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:33.737842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:33.739309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:33.740023 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:33.747486 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:33.747996 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:33.850732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:33.851501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:33.907678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:33.919893 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk 1073741824" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:33.921358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:33.922268 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:33.945990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:33.947354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:33.985042 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:34.025798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:34.026782 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:34.026782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:34.092177 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:34.126697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:34.127769 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Cannot resize image /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:34.128821 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:34.129283 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Ensure instance console log exists: /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:34.129764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:34.130077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:34.130295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:34.149958 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:34.200385 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:34.234672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.165s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:34.235139 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:27:34.326516 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:34.456534 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Detaching volume 10879ea1-3e25-4c10-bbc1-b357964a9ce8
May 14 04:27:34.517430 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Attempting to driver detach volume 10879ea1-3e25-4c10-bbc1-b357964a9ce8 from mountpoint /dev/vdb
May 14 04:27:34.532268 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Found disk vdb by alias ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:34.535071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Found disk vdb by alias ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:34.535291 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Attempting to detach device vdb from instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:27:34.537247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <alias name="ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8"/>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <serial>10879ea1-3e25-4c10-bbc1-b357964a9ce8</serial>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:34.537247 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:34.553722 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Successfully detached device vdb from instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 from the persistent domain config.
May 14 04:27:34.553722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] (1/8): Attempting to detach device vdb with device alias ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8 from instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:27:34.553722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <alias name="ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8"/>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <serial>10879ea1-3e25-4c10-bbc1-b357964a9ce8</serial>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:34.553722 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:34.553722 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:34.615373 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:34.744020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:27:34.747230 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:34.747659 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:34.747896 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:34.830935 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updated VIF entry in instance network info cache for port e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:34.831757 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:34.832980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0df5fea5-c51b-4582-83fd-0235c6243a65 req-685513d1-2af5-4fff-b877-9907ade8c1af service nova] Releasing lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:34.834107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:34.834254 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:34.868673 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79086847c5a343519481b0a50930103f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaef82fed39403a80c7ec4baa8ad091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:35.212247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:35.252981 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:27:35.334560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f6243f2-2440-41c5-9cb3-604f69429568 req-1297f029-d814-43c2-bd4b-3c3697bf68ad service nova] Releasing lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:35.450224 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:35.555510 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Successfully created port: caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:35.721500 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:35.756967 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:27:35.761545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732855.7569606, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:27:35.762259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-10879ea1-3e25-4c10-bbc1-b357964a9ce8 for instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:27:35.766982 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Successfully detached device vdb from instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 from the live domain config.
May 14 04:27:35.768749 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:27:35.770640 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:35.770640 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:35.786166 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:35.922509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:35.923009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10879ea1-3e25-4c10-bbc1-b357964a9ce8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:27:35.923227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:27:35.938149 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:35.965071 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsi session list stdout=tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:35.965569 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:35.965569 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '35')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:27:35.966046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '19')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:35.967281 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8', '18')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:27:35.968633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f847a8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:27:35.968990 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:27:35.970051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Flush multipath device 3300000002cc7dc72 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:27:36.006008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:36.050083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:27:36.090321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:27:36.090569 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:27:36.092387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:27:36.106826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:27:36.107338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:27:36.119392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.157397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.40.100,3260]
May 14 04:27:36.157397 np0000000747 nova-compute[97971]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.40.100,3260] successful.
May 14 04:27:36.157397 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.180719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.198514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.244807 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.50.100,3260]
May 14 04:27:36.244807 np0000000747 nova-compute[97971]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-10879ea1-3e25-4c10-bbc1-b357964a9ce8, portal: 192.168.50.100,3260] successful.
May 14 04:27:36.244807 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.269910 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:36.271877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:36.271877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] <== disconnect_volume: return (501ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:36.271877 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:27:36.309348 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Successfully updated port: caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:27:36.351588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:36.351853 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:36.352092 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Attaching volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 to /dev/vdb
May 14 04:27:36.382194 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-changed-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:36.385726 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Refreshing instance network info cache due to event network-changed-caa81c2c-9fc5-4954-aedd-1d66a1260c92. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:36.385963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] Acquiring lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:36.386120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] Acquired lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:36.386393 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Refreshing network info cache for port caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:36.432313 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:36.440821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:36.441949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance network_info: |[{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:36.444154 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start _get_guest_xml network_info=[{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:36.447854 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:36.450259 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:27:36.453826 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1881911355', uuid='09eb687f-f8dd-4062-b883-f2211b86533e'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732856.4493508) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:36.455311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:36.458765 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:36.460539 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:36.461002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:36.462359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:36.462888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:36.463115 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:36.463277 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:36.463468 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:36.463625 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:36.463784 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:36.464219 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:36.464219 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:36.464300 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:36.464384 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:36.464814 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:36.484513 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881911355',display_name='tempest-ServerRescueNegativeTestJSON-server-1881911355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1881911355',id=18,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-fu68neib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:33Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=09eb687f-f8dd-4062-b883-f2211b86533e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:36.486009 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:36.486914 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:36.487863 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:36.488828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:36.536928 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:27:36.537320 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:27:36.546536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:27:36.550512 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe40:ab68', 'fe80::2883:f9ff:fe85:b582', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe12:28b5'] 
May 14 04:27:36.550803 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:27:36.551068 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:27:36.551538 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:36.552151 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating existing volume attachment record: 2f4651b7-a378-4c70-8a46-c5b60cc5326a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:27:36.774704 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:27:36.776526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:27:36.776877 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Creating image(s)
May 14 04:27:36.778099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:36.778099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:36.778378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:36.779050 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:36.782564 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:36.788106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:36.817116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:36.844854 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'flavor' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:36.894002 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:36.901081 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:36.901081 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:36.901081 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:36.901546 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:36.906307 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:36.907346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:37.017637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <uuid>09eb687f-f8dd-4062-b883-f2211b86533e</uuid>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <name>instance-00000012</name>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1881911355</nova:name>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:36</nova:creationTime>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         <nova:port uuid="f9b6dc47-4e62-4b75-845e-2b20f0e068fb">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="serial">09eb687f-f8dd-4062-b883-f2211b86533e</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="uuid">09eb687f-f8dd-4062-b883-f2211b86533e</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:0b:98:cf"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <target dev="tapf9b6dc47-4e"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/console.log" append="off"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:37.017637 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Preparing to wait for external event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881911355',display_name='tempest-ServerRescueNegativeTestJSON-server-1881911355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1881911355',id=18,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-fu68neib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:33Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=09eb687f-f8dd-4062-b883-f2211b86533e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:37.023466 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:37.025533 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:37.027483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.028680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:37.029303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:37.050312 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:37.051897 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:37.055187 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:37.064922 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.064922 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9febabb-da9d-52de-8891-4d0e9cb753f5', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:37.068218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.068218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:37.071557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.073801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9b6dc47-4e, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:37.076937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9b6dc47-4e, col_values=(('qos', UUID('63a79e48-2875-49e0-8f89-72409d3162b6')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:37.077257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9b6dc47-4e, col_values=(('external_ids', {'iface-id': 'f9b6dc47-4e62-4b75-845e-2b20f0e068fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:98:cf', 'vm-uuid': '09eb687f-f8dd-4062-b883-f2211b86533e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:37.078529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.083518 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:37.088574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:37.089391 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk 1073741824" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:37.090073 np0000000747 nova-compute[97971]: INFO os_vif [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e')
May 14 04:27:37.091733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:37.091733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:37.135922 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:27:37.136608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:37.137031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:37.137827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:37.138269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:27:37.153773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:37.154836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:37.155656 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:37.156409 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:37.156775 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:27:37.157216 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:27:37.177170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:27:37.177170 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:37.187571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:27:37.187571 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:37.198365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976] added
May 14 04:27:37.198365 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:27:37.198365 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:37.198365 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:37.198365 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:37.198365 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:37.198365 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:37.199084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:27:37.199084 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0422(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:27:37.199167 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:27:37.206557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976] added
May 14 04:27:37.206557 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:27:37.206557 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:37.206557 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:37.206557 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:27:37.206557 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:27:37.206557 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:37.206912 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:27:37.206912 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0508(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:27:37.207124 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:27:37.213379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:37.214856 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:27:37.214856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:37.324328 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:37.331645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:37.332950 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Cannot resize image /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:27:37.332950 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:37.332950 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Ensure instance console log exists: /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:27:37.333716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:37.334058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:37.334373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:37.827246 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf68a0f8-dbeb-42c9-b38e-90566fb77ec7 req-2cc6ed34-d6b6-4e32-a2ec-401b09d0ee54 service nova] Releasing lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:37.827734 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:37.827941 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:37.857118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ed5b6a5-1fe5-43fe-9205-864bd149e456 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.911s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:38.199754 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:27:38.208382 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:38.217375 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:38.217375 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:38.227390 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:38.227390 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.234859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.244080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.263642 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.272649 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.274902 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:38.324122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.50.100,3260]
May 14 04:27:38.324122 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.50.100,3260] successful.
May 14 04:27:38.324122 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.325244 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.40.100,3260]
May 14 04:27:38.325244 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.40.100,3260] successful.
May 14 04:27:38.325244 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.344661 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.355792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.377592 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.381141 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:38.381141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:38.383418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '-', '-', 0) found on session 38 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:38.383418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.385819 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:38.386658 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:38.386658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:38.389318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '-', '-', 0) found on session 39 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:38.389783 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:38.441192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 39 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:38.441192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 38 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:38.441192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:38.453229 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:27:38.642685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:38.643007 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:38.643397 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:0b:98:cf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:38.644078 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Using config drive
May 14 04:27:38.716231 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:38.817565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:38.817871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:38.818179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:38.818565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:38.820201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:38.822093 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Terminating instance
May 14 04:27:38.890037 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Updating instance_info_cache with network_info: [{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:39.155448 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:39.326072 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:27:39.333422 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Creating config drive at /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config
May 14 04:27:39.339704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wgrmu6s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:39.372514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.379847 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.395349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:39.395349 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance network_info: |[{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:27:39.399087 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wgrmu6s" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:39.405516 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start _get_guest_xml network_info=[{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:39.411909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.417293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.429955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 39 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:39.429955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:39.435327 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:39.436794 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-728986131', uuid='26b8a48c-e7dd-4ac7-a362-1ef4ef56360a'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732859.4363449) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:39.452965 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.456944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:39.457516 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:39.461259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:39.461364 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:39.463796 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:39.463796 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:39.463796 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:39.463796 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:39.470881 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:39.471068 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:39.471229 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:39.472264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:39.472264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:39.472264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:39.472264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:39.472264 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:39.488488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728986131',display_name='tempest-ServerRescueNegativeTestJSON-server-728986131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-728986131',id=19,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-56ihvza1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:36Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=26b8a48c-e7dd-4ac7-a362-1ef4ef56360a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:39.488488 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:39.488488 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:39.488970 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:39.651131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:39.653180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:39.653500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:39.653698 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:39.654023 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:39.654666 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-11e01953-9ea0-4093-bc21-22ea72931aef req-92263f65-65c9-4680-837e-2309f809f144 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:27:39.992463 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <uuid>26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</uuid>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <name>instance-00000013</name>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-728986131</nova:name>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:39</nova:creationTime>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         <nova:port uuid="caa81c2c-9fc5-4954-aedd-1d66a1260c92">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="serial">26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="uuid">26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:6b:d0"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <target dev="tapcaa81c2c-9f"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/console.log" append="off"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:39.992463 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Preparing to wait for external event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728986131',display_name='tempest-ServerRescueNegativeTestJSON-server-728986131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-728986131',id=19,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-56ihvza1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:36Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=26b8a48c-e7dd-4ac7-a362-1ef4ef56360a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:27:39.994819 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:39.995345 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:39.995683 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:27:39.996191 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.996482 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:39.996725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:27:39.998425 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:39.998693 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '892bbe9f-8cdc-5bcb-adca-78d1ee0c0d8e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.002880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.004513 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:40.016971 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.021117 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.021117 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaa81c2c-9f, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.022189 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaa81c2c-9f, col_values=(('qos', UUID('8a58377b-7020-4980-bf71-3797896a690b')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.022830 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaa81c2c-9f, col_values=(('external_ids', {'iface-id': 'caa81c2c-9fc5-4954-aedd-1d66a1260c92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:6b:d0', 'vm-uuid': '26b8a48c-e7dd-4ac7-a362-1ef4ef56360a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.029393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.029393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:40.057432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.059397 np0000000747 nova-compute[97971]: INFO os_vif [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f')
May 14 04:27:40.090880 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99952524299988 future=<Future at 0x7435f842c170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:40.097141 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.993220797000049 future=<Future at 0x7435f842c170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:40.099287 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.992945748000011 future=<Future at 0x7435f842c170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:40.102531 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Instance destroyed successfully.
May 14 04:27:40.103279 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lazy-loading 'resources' on Instance uuid b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:40.111691 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.162041 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.188186 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 33000000099ce509d for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:27:40.188726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:40.188836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '33000000099ce509d', 'path': '/dev/dm-1', 'multipath_id': '33000000099ce509d'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:40.188995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099ce509d', 'path': '/dev/dm-1', 'multipath_id': '33000000099ce509d'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:27:40.195765 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:40.282391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.550390 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.568879 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.572308 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.591373 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f57beff0-5550-4fe6-b8dc-a34d5c3606a8 req-59704e99-2ccb-46b1-83bf-bc98484f4eeb service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:40.592255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f57beff0-5550-4fe6-b8dc-a34d5c3606a8 req-59704e99-2ccb-46b1-83bf-bc98484f4eeb service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:40.592994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f57beff0-5550-4fe6-b8dc-a34d5c3606a8 req-59704e99-2ccb-46b1-83bf-bc98484f4eeb service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:40.593280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f57beff0-5550-4fe6-b8dc-a34d5c3606a8 req-59704e99-2ccb-46b1-83bf-bc98484f4eeb service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:40.593603 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f57beff0-5550-4fe6-b8dc-a34d5c3606a8 req-59704e99-2ccb-46b1-83bf-bc98484f4eeb service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Processing event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:40.603773 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.608600 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-745630866',display_name='tempest-ServerStableDeviceRescueTest-server-745630866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverstabledevicerescuetest-server-745630866',id=6,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAci6SWH7DYnU3OQ7wwqiBWjKYBDwI40fqWKHcg0oJjrwHacFR2KTwRhEez9K8yY3e2SxIZYu8+NEs2T6qa3w0GdJzu5BLDCp479vU1b6G1ASQs92vA6WhdycehHbaBZ+A==',key_name='tempest-keypair-1510039878',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:51Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d49cec32e7e4e59ab41cd04147db756',ramdisk_id='',reservation_id='r-0h085c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-933200266',owner_user_name='tempest-ServerStableDeviceRescueTest-933200266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5b93fa488e469cab3d35f0d0283061',uuid=b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:27:40.608600 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converting VIF {"id": "cb034d60-b075-479f-9b34-57325e1c0d65", "address": "fa:16:3e:40:ab:68", "network": {"id": "17ee8482-b730-434f-874a-08f31dcd4363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1942139163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2d49cec32e7e4e59ab41cd04147db756", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb034d60-b0", "ovs_interfaceid": "cb034d60-b075-479f-9b34-57325e1c0d65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:40.609294 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:40.609795 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:27:40.611807 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.612086 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb034d60-b0, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.613570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.617257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:40.627543 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.629145 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.629478 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8387f708-07bb-42e4-95bf-4786c5f5eb7f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:27:40.630569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.631388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:27:40.645746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:40.649595 np0000000747 nova-compute[97971]: INFO os_vif [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ab:68,bridge_name='br-int',has_traffic_filtering=True,id=cb034d60-b075-479f-9b34-57325e1c0d65,network=Network(17ee8482-b730-434f-874a-08f31dcd4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb034d60-b0')
May 14 04:27:40.649595 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Deleting instance files /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57_del
May 14 04:27:40.649595 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Deletion of /opt/stack/data/nova/instances/b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57_del complete
May 14 04:27:40.697383 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Attempting to attach volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:27:40.701828 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:40.701828 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:27:40.789515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:41.108483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:41.160518 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Took 1.83 seconds to destroy the instance on the hypervisor.
May 14 04:27:41.161187 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:27:41.161508 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:27:41.161640 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:27:41.162151 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:41.195355 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:41.197113 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732861.1962016, 09eb687f-f8dd-4062-b883-f2211b86533e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:41.197113 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Started (Lifecycle Event)
May 14 04:27:41.199930 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:41.203355 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance spawned successfully.
May 14 04:27:41.204077 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:41.258757 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:41.584746 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:41.584746 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:41.586059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:9c:6b:d0, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:41.586059 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Using config drive
May 14 04:27:41.703089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:41.710519 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:41.713440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.713642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.714059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.714375 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.717638 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.718430 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:41.765800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:41.766049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] Acquiring lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:41.766116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:41.766259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:41.766410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] No waiting events found dispatching network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:41.766553 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efb58d8d-c069-4c72-b30a-bd093a225c19 req-bf905484-0cff-4082-ad96-fd78e6050452 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-unplugged-cb034d60-b075-479f-9b34-57325e1c0d65 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:27:42.102071 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:42.215274 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:42.215672 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732862.2153866, 09eb687f-f8dd-4062-b883-f2211b86533e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:42.215878 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Paused (Lifecycle Event)
May 14 04:27:42.223000 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Took 8.60 seconds to spawn the instance on the hypervisor.
May 14 04:27:42.223377 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:42.293397 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Creating config drive at /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config
May 14 04:27:42.299125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9j8a8pt {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:42.350868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9j8a8pt" returned: 0 in 0.051s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:42.383047 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:42.413371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:42.413371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:42.413546 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:42.413691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:db:64:7f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:42.690034 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:42.690034 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:42.690399 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:42.690399 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:42.690475 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:42.691016 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state None.
May 14 04:27:42.691136 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4fa36311-ded8-45c8-bd02-d450297beb2c req-c8e3824a-d166-42f8-9baa-579b702926a6 service nova] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Received event network-vif-deleted-cb034d60-b075-479f-9b34-57325e1c0d65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:42.718528 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:42.720248 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732862.7199876, 09eb687f-f8dd-4062-b883-f2211b86533e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:42.720427 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Resumed (Lifecycle Event)
May 14 04:27:42.732783 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Took 15.03 seconds to build instance.
May 14 04:27:42.818750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:42.856563 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:42.858873 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:42.886888 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Took 1.73 seconds to deallocate network for instance.
May 14 04:27:42.953741 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:42.980102 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:42.982715 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:43.047147 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-146618dc-28c5-4560-9116-6ba464533a8b req-58732fb5-3dd2-4d04-9f27-eedf10758073 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:43.047147 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-146618dc-28c5-4560-9116-6ba464533a8b req-58732fb5-3dd2-4d04-9f27-eedf10758073 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:43.047147 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-146618dc-28c5-4560-9116-6ba464533a8b req-58732fb5-3dd2-4d04-9f27-eedf10758073 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:43.047147 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-146618dc-28c5-4560-9116-6ba464533a8b req-58732fb5-3dd2-4d04-9f27-eedf10758073 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:43.047443 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-146618dc-28c5-4560-9116-6ba464533a8b req-58732fb5-3dd2-4d04-9f27-eedf10758073 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Processing event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:27:43.225847 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:43.231563 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:43.236091 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4b24bf61-3a1b-4b7a-bdfa-63bcd716c532 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.545s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:43.394516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:43.394701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:43.842002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:43.842486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:43.872806 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732863.8724468, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:43.874745 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Started (Lifecycle Event)
May 14 04:27:43.876896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:27:43.885252 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:27:43.894472 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance spawned successfully.
May 14 04:27:43.894842 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:27:44.007428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-752f5780-6908-4aa7-a701-f9b6ac681e1a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.655s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:44.191525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:27:44.191833 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:27:44.347370 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:44.379457 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:44.385499 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:44.412036 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.412188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.412556 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.412853 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.413165 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.413474 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:27:44.695145 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:27:44.887832 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:27:44.887832 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732864.8868463, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:44.887832 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Paused (Lifecycle Event)
May 14 04:27:44.919110 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Took 8.14 seconds to spawn the instance on the hypervisor.
May 14 04:27:44.919267 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:45.107082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:45.107297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:45.107514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:45.107728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:45.108096 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:45.108267 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5f407124-3d96-41d9-a616-3b6deb4064ea req-6943e6da-0536-450a-ab96-dc8c92412d33 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received unexpected event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with vm_state active and task_state None.
May 14 04:27:45.204155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.809s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:45.275068 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Deleted allocations for instance b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57
May 14 04:27:45.353132 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:45.390946 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:45.394097 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732865.393033, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:45.394097 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Resumed (Lifecycle Event)
May 14 04:27:45.430721 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Took 16.76 seconds to build instance.
May 14 04:27:45.632053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:45.793657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:45.897414 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:45.902962 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:45.935305 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ebfcbbe1-85f5-4683-8bf3-76eb8cbb4349 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.272s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:46.287037 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd56d5f8-a7bf-490e-b93c-e0da5a57e806 tempest-ServerStableDeviceRescueTest-933200266 tempest-ServerStableDeviceRescueTest-933200266-project-member] Lock "b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.468s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:46.486637 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Rescuing
May 14 04:27:46.486637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:46.486637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:46.486637 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:27:46.532865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:46.533076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:46.533337 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Attaching volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 to /dev/vdb
May 14 04:27:46.597413 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:46.612358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:27:46.639007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:46.680966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:27:46.681263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:27:46.691247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:27:46.696046 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0'] 
May 14 04:27:46.697873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:27:46.697873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:27:46.697873 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:46.698159 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating existing volume attachment record: c0ae9025-66ee-4cd0-bb13-ac3648f0041e {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:27:46.990757 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:47.269455 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:27:47.269455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:47.269455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:47.269455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:47.269455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:27:47.287063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:47.288537 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:47.288976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:27:47.289376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:27:47.289609 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:27:47.290011 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:47.309978 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:47.309978 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:27:47.322185 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:27:47.322185 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:47.339761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:47.342498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.374710 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.375059 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:47.376961 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.086s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:47.376961 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:47.377800 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '0', '0', 0) found on session 38 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:47.379717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.381465 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:27:47.381946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:27:47.382226 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.094s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:47.383146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:27:47.383795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '0', '0', 0) found on session 39 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:27:47.383795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:27:47.398683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 38 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:47.398683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:47.402140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 39 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:27:47.402433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:27:47.444522 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:47.637206 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Updating instance_info_cache with network_info: [{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:48.140478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:48.293576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:27:49.324566 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 33000000099ce509d for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:27:49.325125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.056s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:27:49.325125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (2056ms) {'type': 'block', 'scsi_wwn': '33000000099ce509d', 'path': '/dev/dm-1', 'multipath_id': '33000000099ce509d'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:49.325260 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099ce509d', 'path': '/dev/dm-1', 'multipath_id': '33000000099ce509d'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:27:49.328728 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:49.785490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:49.815897 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:49.822125 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:49.836550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Attempting to attach volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:27:49.845650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:49.849709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:49.849709 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:27:50.052133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:50.064660 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:50.102356 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:50.102645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:50.104692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:50.104692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:50.104692 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:50.104692 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0bab101b-bae1-4c34-8f23-781e95a2b227 req-7a153d98-24b6-437c-9d7a-79e5e91e8904 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received unexpected event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with vm_state active and task_state rescuing.
May 14 04:27:50.209661 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999617523000097 future=<Future at 0x74361822b020 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:50.209661 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance destroyed successfully.
May 14 04:27:50.210381 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'numa_topology' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:50.633271 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:50.718292 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Attempting rescue
May 14 04:27:50.719244 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:27:50.722876 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:27:50.723166 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Creating image(s)
May 14 04:27:50.723984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:50.724164 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:50.724798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:50.725092 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:50.797159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:51.227057 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:51.227837 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:51.230369 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:51.231911 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:51.232275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:51.232552 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:51.235330 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:27:51.235823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:51.353884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:51.354382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:51.416700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:51.417194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:51.417725 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'migration_context' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:51.608826 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:51.609013 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:51.609069 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:51.610640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:12:28:b5, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:51.921590 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:51.922195 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:27:51.922776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start _get_guest_xml network_info=[{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:6b:d0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:27:51.923000 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:52.188344 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:52.188594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:52.188858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:52.189002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:52.190219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:52.190219 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fc76568d-b572-4f8f-8a30-330a256ffc2d req-c916fc44-1f32-4601-bfe6-0dbe9a52a157 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received unexpected event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with vm_state active and task_state rescuing.
May 14 04:27:52.426531 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:52.429715 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:27:52.431890 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-728986131', uuid='26b8a48c-e7dd-4ac7-a362-1ef4ef56360a'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:6b:d0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732872.4314158) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:27:52.435297 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:27:52.436463 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:27:52.437157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:27:52.437414 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:27:52.438910 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:27:52.438910 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:27:52.439148 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:27:52.439148 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:27:52.439265 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:27:52.439605 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:27:52.439769 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:27:52.439969 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:27:52.440085 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:27:52.440185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:27:52.440306 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:27:52.440419 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:27:52.440581 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:52.943648 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:52.967923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728986131',display_name='tempest-ServerRescueNegativeTestJSON-server-728986131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-728986131',id=19,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:44Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-56ihvza1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:45Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=26b8a48c-e7dd-4ac7-a362-1ef4ef56360a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:6b:d0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:27:52.968166 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:6b:d0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:27:52.968897 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:27:52.970528 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:53.199527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-81d8f8a4-41be-476b-8459-5b8f9a6f3b7d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.666s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:53.472968 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:53.474702 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <uuid>26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</uuid>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <name>instance-00000013</name>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-728986131</nova:name>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:27:52</nova:creationTime>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         <nova:port uuid="caa81c2c-9fc5-4954-aedd-1d66a1260c92">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <system>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="serial">26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="uuid">26b8a48c-e7dd-4ac7-a362-1ef4ef56360a</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </system>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <os>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </os>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <features>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </features>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   <devices>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config.rescue"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </disk>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:6b:d0"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <target dev="tapcaa81c2c-9f"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </interface>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/console.log" append="off"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </serial>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <video>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </video>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </rng>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:   </devices>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]: </domain>
May 14 04:27:53.474702 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:27:53.482052 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance destroyed successfully.
May 14 04:27:53.815993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:53.815993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:54.319468 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Detaching volume 034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:54.411965 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Attempting to driver detach volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 from mountpoint /dev/vdb
May 14 04:27:54.418326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:54.420456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:54.420890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Attempting to detach device vdb from instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:27:54.422738 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:54.422738 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:54.435921 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 from the persistent domain config.
May 14 04:27:54.436354 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] (1/8): Attempting to detach device vdb with device alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 from instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:27:54.436441 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:54.436441 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:55.004704 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732875.0041108, 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 => ua-034e2a15-6326-4d5a-b8d9-44cc5395b976> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:27:55.006625 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 for instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:27:55.007308 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:55.007504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:55.007674 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:27:55.007813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:9c:6b:d0, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:27:55.008376 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Using config drive
May 14 04:27:55.016801 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 from the live domain config.
May 14 04:27:55.091038 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0006614440001158073 future=<Future at 0x7435f842c170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:55.091196 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:55.091284 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.116440612999895 future=<Future at 0x74361822b020 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:55.091328 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.116345267000042 future=<Future at 0x74361822b020 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:27:55.091866 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778732860.0902371, b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:55.091988 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] VM Stopped (Lifecycle Event)
May 14 04:27:55.515267 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'ec2_ids' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:55.563762 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Detected multiple connections on this host for volume: 034e2a15-6326-4d5a-b8d9-44cc5395b976, skipping target disconnect.
May 14 04:27:55.594902 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-29196c8c-7f94-4e36-925f-d4a8932e2836 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: b5bbf02c-d0d2-4dec-87c1-d78dcc9b5d57] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:55.633889 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:55.801962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:56.018753 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:56.018903 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'keypairs' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:56.134774 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:56.329488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:56.332421 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing instance network info cache due to event network-changed-08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:56.332764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] Acquiring lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:56.332940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] Acquired lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:56.333147 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Refreshing network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:56.523717 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<26b8a48c-e7dd-4ac7-a362-1ef4ef56360a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:56.530891 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:56.728821 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Creating config drive at /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config.rescue
May 14 04:27:56.732165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl6w4e_5b {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:56.783189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl6w4e_5b" returned: 0 in 0.050s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:27:56.839665 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:57.111865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:57.112135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:57.146358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d5de18-7c3c-4976-9164-a43f6001632d tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.331s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:57.255139 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:57.347675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:57.347675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:57.363498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:57.390895 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:57.396357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:57.459193 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updated VIF entry in instance network info cache for port 08d656ba-4789-4687-9c3a-eaaf2593b3dd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:57.459807 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [{"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:57.511714 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:57.528774 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:27:57.619663 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:57.654355 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:57.654579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:57.654833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:57.655367 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:57.655595 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:57.656280 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2e7b5b34-f705-4f18-868c-2b85bff9dd54 req-67aaea5c-aa1b-4aa6-889f-7a16eeabe040 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received unexpected event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with vm_state active and task_state rescuing.
May 14 04:27:57.811121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:57.811318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:57.811768 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:57.848944 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Detaching volume 034e2a15-6326-4d5a-b8d9-44cc5395b976
May 14 04:27:57.935571 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Attempting to driver detach volume 034e2a15-6326-4d5a-b8d9-44cc5395b976 from mountpoint /dev/vdb
May 14 04:27:57.944397 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:57.945990 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:27:57.946145 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Attempting to detach device vdb from instance 5d42ebce-6d76-4893-b335-bceb7181a83a from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:27:57.946471 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:57.946471 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:57.956297 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 5d42ebce-6d76-4893-b335-bceb7181a83a from the persistent domain config.
May 14 04:27:57.956709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] (1/8): Attempting to detach device vdb with device alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 from instance 5d42ebce-6d76-4893-b335-bceb7181a83a from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:27:57.957499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <alias name="ua-034e2a15-6326-4d5a-b8d9-44cc5395b976"/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <serial>034e2a15-6326-4d5a-b8d9-44cc5395b976</serial>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]: </disk>
May 14 04:27:57.957499 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:27:57.962139 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1f26c5be-0150-41aa-a17b-67ba034361a9 req-0009f873-31fc-452d-8e61-9092073f4753 service nova] Releasing lock "refresh_cache-34b571d5-617e-4f48-8368-7bb5fc36bfa2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:27:58.316303 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:58.445993 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-changed-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:58.446707 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Refreshing instance network info cache due to event network-changed-ba6c2eff-a446-4a05-b7e7-8c029f9d431c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:27:58.446916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] Acquiring lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:27:58.447045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] Acquired lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:27:58.447983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Refreshing network info cache for port ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:27:58.458428 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a due to new event <LifecycleEvent: 1778732878.4574971, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:27:58.458764 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732878.4574971, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:58.458991 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Resumed (Lifecycle Event)
May 14 04:27:58.467342 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4ce7d13f-e7c2-40a2-b3b0-9c61bc385e0a tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:58.544186 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'pci_requests' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:27:58.628827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:58.950712 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:58.967906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:58.971349 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:27:59.047544 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Object Instance<c249f70f-670b-4f62-adad-6093dc284b23> lazy-loaded attributes: flavor,pci_requests {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:27:59.047820 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:27:59.049717 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:59.050124 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:59.195550 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7778c84ee3f3406999f838e5009483a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781e2f73cfe2496391efde04eee02a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:27:59.476063 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732879.4756389, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:27:59.476596 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Started (Lifecycle Event)
May 14 04:27:59.653469 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:27:59.761049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:59.761482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:59.761757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Attaching volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 to /dev/vdb
May 14 04:27:59.789019 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:27:59.789019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:27:59.789019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:27:59.789019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:27:59.789019 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:27:59.790741 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b79e04b6-db3e-4f48-9fc4-5b23fe3493a0 req-bdbd320b-ca65-44db-988a-cb5bf7f73c06 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received unexpected event network-vif-plugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with vm_state rescued and task_state None.
May 14 04:27:59.847601 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:27:59.867054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:27:59.902842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:27:59.928664 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Successfully created port: 4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:27:59.943125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:27:59.944379 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:27:59.955939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:27:59.959738 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fefb:3988', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0'] 
May 14 04:27:59.959973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:27:59.960185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:27:59.960483 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:27:59.960788 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating existing volume attachment record: f97d4a22-a4a1-46c7-9ada-5a6e6a5ae64b {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:27:59.981890 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:27:59.985344 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updated VIF entry in instance network info cache for port ba6c2eff-a446-4a05-b7e7-8c029f9d431c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:27:59.985875 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating instance_info_cache with network_info: [{"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:27:59.993051 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:00.198079 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:00.494915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb10421-350a-4141-a60a-3dee3f9ff521 req-a87ae770-5ee1-4da4-b612-41d7345b1bfa service nova] Releasing lock "refresh_cache-29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:00.548857 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:00.548857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:00.548857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:00.548857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:00.549096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:00.564761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:00.564761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:00.565317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:00.565501 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:00.565894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:00.566102 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:00.586297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:00.586297 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:00.591398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:00.591398 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98] added
May 14 04:28:00.608111 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:00.608111 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0418(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:00.608111 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:00.612906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98] added
May 14 04:28:00.612906 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:00.612906 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:00.612906 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:00.612906 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:00.612906 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:00.612906 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:00.613282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:00.613984 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0473(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:00.613984 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:00.635272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:00.805069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:00.907135 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Successfully updated port: 4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:00.977736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-changed-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:00.977736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing instance network info cache due to event network-changed-4b63c1ee-11b8-42bd-8dff-fa978bc85a65. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:00.977736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:00.977736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:00.977736 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Refreshing network info cache for port 4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:00.998530 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732880.9972966, 5d42ebce-6d76-4893-b335-bceb7181a83a => ua-034e2a15-6326-4d5a-b8d9-44cc5395b976> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:01.000888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-034e2a15-6326-4d5a-b8d9-44cc5395b976 for instance 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:01.004805 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 5d42ebce-6d76-4893-b335-bceb7181a83a from the live domain config.
May 14 04:28:01.056877 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:01.057324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:01.057596 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:01.412710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:01.481349 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:01.608112 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:01.615652 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:01.626444 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:01.626444 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:01.637630 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:01.637630 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.645888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.653785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.668523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:01.668523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.673106 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.678552 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.679055 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:01.738472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.50.100,3260]
May 14 04:28:01.738472 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.50.100,3260] successful.
May 14 04:28:01.738472 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.748779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.40.100,3260]
May 14 04:28:01.748779 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.40.100,3260] successful.
May 14 04:28:01.748779 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.766658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.780900 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.808517 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.809479 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.243s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:01.809479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:01.810901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] HCTL ('18', '-', '-', 0) found on session 41 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:01.811024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.812868 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:01.813288 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:01.813687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.248s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:01.813687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:01.816430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] HCTL ('17', '-', '-', 0) found on session 40 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:01.816578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:01.835687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching for a device in session 41 and hctl ['18', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:01.844148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching for a device in session 40 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:01.844148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:01.965152 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Rescuing
May 14 04:28:01.965401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:01.965551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:01.966168 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:01.993467 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:02.173757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Detaching volume c040e303-a25c-41fa-bebc-296f7d894996
May 14 04:28:02.185053 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Added VIF to instance network info cache for port 4b63c1ee-11b8-42bd-8dff-fa978bc85a65. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3528}}
May 14 04:28:02.185953 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:02.231907 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Attempting to driver detach volume c040e303-a25c-41fa-bebc-296f7d894996 from mountpoint /dev/vdb
May 14 04:28:02.240076 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found disk vdb by alias ua-c040e303-a25c-41fa-bebc-296f7d894996 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:02.242103 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found disk vdb by alias ua-c040e303-a25c-41fa-bebc-296f7d894996 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:02.242339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Attempting to detach device vdb from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:28:02.242594 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <alias name="ua-c040e303-a25c-41fa-bebc-296f7d894996"/>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <serial>c040e303-a25c-41fa-bebc-296f7d894996</serial>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:02.242594 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:02.251917 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully detached device vdb from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the persistent domain config.
May 14 04:28:02.252186 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] (1/8): Attempting to detach device vdb with device alias ua-c040e303-a25c-41fa-bebc-296f7d894996 from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:28:02.252495 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <alias name="ua-c040e303-a25c-41fa-bebc-296f7d894996"/>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <serial>c040e303-a25c-41fa-bebc-296f7d894996</serial>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:02.252495 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:02.468150 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:02.689742 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d70c86be-9c87-4023-a528-6a731c59077c req-d398e86e-4e8d-4b2e-91a3-0fb3ef0eb1b7 service nova] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:02.690088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:02.690315 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:02.836647 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:02.848190 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching for a device in session 41 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:02.848383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:02.948412 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732882.9480195, eb9bb511-c615-4ea8-9fa3-c784c88a680d => ua-c040e303-a25c-41fa-bebc-296f7d894996> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:02.950194 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c040e303-a25c-41fa-bebc-296f7d894996 for instance eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:02.954474 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully detached device vdb from instance eb9bb511-c615-4ea8-9fa3-c784c88a680d from the live domain config.
May 14 04:28:02.958378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:02.958679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:02.958958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:03.008544 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:03.276822 np0000000747 nova-compute[97971]: WARNING nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] d64631a9-48a5-4df6-9d0f-e0a6e7a39c25 already exists in list: networks containing: ['d64631a9-48a5-4df6-9d0f-e0a6e7a39c25']. ignoring it
May 14 04:28:03.277230 np0000000747 nova-compute[97971]: WARNING nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] 4b63c1ee-11b8-42bd-8dff-fa978bc85a65 already exists in list: port_ids containing: ['4b63c1ee-11b8-42bd-8dff-fa978bc85a65']. ignoring it
May 14 04:28:03.495878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:03.510167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:03.553731 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:03.588453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found WWN 33000000036e66b10 for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:28:03.589041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:03.589235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '33000000036e66b10', 'path': '/dev/dm-9', 'multipath_id': '33000000036e66b10'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:03.589384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000036e66b10', 'path': '/dev/dm-9', 'multipath_id': '33000000036e66b10'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:28:03.589787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.532s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:03.590092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '034e2a15-6326-4d5a-b8d9-44cc5395b976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:03.590274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:03.593865 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.632080 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.632677 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:03.632677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:03.633185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', '39')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:03.634246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976', '38')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:03.635395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f85e4900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:03.635602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:03.635973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flush multipath device 33000000099ce509d {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:03.669886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:03.710413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:03.747339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:03.747504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:03.749761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:03.763063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:03.763284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:03.777662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.818001 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.40.100,3260]
May 14 04:28:03.818001 np0000000747 nova-compute[97971]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.40.100,3260] successful.
May 14 04:28:03.818001 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.841013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.856324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.912991 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.50.100,3260]
May 14 04:28:03.912991 np0000000747 nova-compute[97971]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-034e2a15-6326-4d5a-b8d9-44cc5395b976, portal: 192.168.50.100,3260] successful.
May 14 04:28:03.912991 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.942057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:03.942057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:03.942328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== disconnect_volume: return (2884ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:03.942328 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:03.943737 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.985s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:03.945636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c040e303-a25c-41fa-bebc-296f7d894996', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:03.945636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:03.977930 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.979626 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:03.979962 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:03.979962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:03.980295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '35')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:03.982113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996', '34')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:03.983283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436183239c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:03.983492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:03.983768 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flush multipath device 3300000001b61f96e {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:04.020251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:04.070606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:04.098797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Attempting to attach volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:28:04.099897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:04.099897 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:28:04.121636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:04.121834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:04.127127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:04.144734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:04.144928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:04.161482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.192562 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:04.209362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260]
May 14 04:28:04.209362 np0000000747 nova-compute[97971]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.40.100,3260] successful.
May 14 04:28:04.209362 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.234904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.251919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.297929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260]
May 14 04:28:04.297929 np0000000747 nova-compute[97971]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-c040e303-a25c-41fa-bebc-296f7d894996, portal: 192.168.50.100,3260] successful.
May 14 04:28:04.297929 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.330822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:04.330822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:04.330822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== disconnect_volume: return (1370ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:04.330822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:04.489802 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:04.697196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:04.699049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:04.699266 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:04.699879 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:04.700137 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:04.700412 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.700654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:04.700923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:04.701958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.702142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc9ddd1-28fe-5863-b939-10f2e334365a', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:04.703233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.704595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.707729 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.707918 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b63c1ee-11, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:04.708250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b63c1ee-11, col_values=(('qos', UUID('3a724c81-9fe4-4eac-ad2e-1fb7be151f14')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:04.708424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b63c1ee-11, col_values=(('external_ids', {'iface-id': '4b63c1ee-11b8-42bd-8dff-fa978bc85a65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a1:01', 'vm-uuid': 'c249f70f-670b-4f62-adad-6093dc284b23'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:04.710960 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:04.716673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.717769 np0000000747 nova-compute[97971]: INFO os_vif [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11')
May 14 04:28:04.718432 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:04.718584 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:04.719101 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:04.720271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] attach device xml: <interface type="ethernet">
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:   <mac address="fa:16:3e:f5:a1:01"/>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:   <model type="virtio"/>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:   <driver name="qemu"/>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:   <mtu size="1372"/>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:   <target dev="tap4b63c1ee-11"/>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]: </interface>
May 14 04:28:04.720271 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:28:04.732746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.800642 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.802724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.806834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.842419 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:04.901484 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'flavor' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:05.021127 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:05.021393 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:05.022673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:05.022673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:05.022673 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:05.022673 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ffa18888-1499-4842-9300-5ee70ae3b5ff req-4651f055-1a0d-482a-bc2a-e7f0753135cd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received unexpected event network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 for instance with vm_state active and task_state None.
May 14 04:28:05.090134 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.092056 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.095308 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.118864 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.121713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.167223 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.174033 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.198941 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.208062 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00033075800001824973 future=<Future at 0x74361822b020 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:05.208313 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:05.395314 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.404334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.413226 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:05.414952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:05.414952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:05.415377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:05.415676 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:05.417281 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-49d99ac9-c9b2-4e89-ac91-4062562d604a req-9f40a816-ad18-44be-bea6-bc580da14c89 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state rescuing.
May 14 04:28:05.502764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5f6c63-8825-4c64-8337-b960ad2f4d9a tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:05.511384 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999589521999951 future=<Future at 0x7435f84b32c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:05.511711 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999248741999963 future=<Future at 0x7435f84b32c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:05.511830 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999097501999813 future=<Future at 0x7435f84b32c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:05.513342 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance destroyed successfully.
May 14 04:28:05.513793 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'numa_topology' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:05.806759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:05.829348 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:05.829681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:05.829837 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:05.829987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No VIF found with MAC fa:16:3e:ef:36:e4, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:05.918519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68617542-2acf-4fbf-9e88-499efcfd41ab tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:06.018516 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Attempting rescue
May 14 04:28:06.019530 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:28:06.022901 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:28:06.023025 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Creating image(s)
May 14 04:28:06.023724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:06.023867 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:06.024333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:06.024493 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:06.107592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:06.107770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:06.107933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:06.108047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:06.108203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:06.112252 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Terminating instance
May 14 04:28:06.378548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:06.378822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:06.379357 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No VIF found with MAC fa:16:3e:a5:f7:19, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:06.527641 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:06.527641 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:06.530818 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:06.534321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:06.534682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:06.534965 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:06.539079 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:06.540897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:06.615014 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:28:06.638121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:06.639970 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:06.658974 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.686106 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.714293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:06.715084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:06.715471 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'migration_context' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:06.794316 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.805582 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.885346 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1159631461', uuid='c249f70f-670b-4f62-adad-6093dc284b23'), owner=OwnerMeta(userid='7778c84ee3f3406999f838e5009483a3', username='tempest-TaggedAttachmentsTest-1756793520-project-member', projectid='781e2f73cfe2496391efde04eee02a9e', projectname='tempest-TaggedAttachmentsTest-1756793520'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732886.8846586) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:06.888199 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:06</nova:creationTime>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     <nova:port uuid="4b63c1ee-11b8-42bd-8dff-fa978bc85a65">
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:06.888199 np0000000747 nova-compute[97971]:  {{(pid=97971) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 04:28:06.944680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.963743 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:06.980772 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99629424900013 future=<Future at 0x7435f8338950 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:06.982589 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Instance destroyed successfully.
May 14 04:28:06.983085 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'resources' on Instance uuid eb9bb511-c615-4ea8-9fa3-c784c88a680d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:07.127390 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.127663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.139891 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:07.140167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.141589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.141763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.141965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:07.142269 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6e87304e-e86e-4cfa-b296-d77641ee9aaf req-fee598eb-da9f-4bb6-9730-295c8d3a719d service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received unexpected event network-vif-plugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 for instance with vm_state active and task_state None.
May 14 04:28:07.145124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.145300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.219086 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:07.219383 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:28:07.219896 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start _get_guest_xml network_info=[{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:0b:98:cf"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:07.220083 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:07.396369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8612acd1-1589-445c-ba6a-eca6622901a4 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 9.585s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.411057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-04888109-15c5-464b-b17c-7507092febb0 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.650s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.472926 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:07.473186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.473403 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.473581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.474034 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:07.474286 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state rescuing.
May 14 04:28:07.474455 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:07.474766 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.474888 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.475126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.475316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:07.475467 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:07.475675 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:07.475869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Acquiring lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:07.476076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:07.476266 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:07.476943 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] No waiting events found dispatching network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:07.477112 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9aa9646-2893-4755-bd87-d3b298dbdf04 req-ca54c65e-a6ee-4e3b-a325-b486931b0d1b service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-unplugged-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:07.485570 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:25:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-333845418',display_name='tempest-ServerActionsTestOtherA-server-330518108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-tempest-common-compute-instance-333845418',id=8,image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwntouaxrKT5UcWYaDwy2SQTseVo3YPwD0Ntm2K70fiYZa7hWT5XVRDE57JVs/OoE+yQa6bA+S+S9MDE3JUIqDLU2FUSUAWRixrrjN1DmhX+VUgjGw+VyubYSc6BII96A==',key_name='tempest-keypair-1033919746',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-r4n8i1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=eb9bb511-c615-4ea8-9fa3-c784c88a680d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:07.485847 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "address": "fa:16:3e:fb:39:88", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd14b0b96-59", "ovs_interfaceid": "d14b0b96-59d7-4fb2-8b83-fb72d95bd884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:07.486656 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:07.486951 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:07.489258 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.489492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd14b0b96-59, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:07.490750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.492832 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:07.497351 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.498214 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.498419 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20ccf50b-1e3b-41a7-bb24-fa29ef2b2ae9) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:07.499733 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.499867 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:07.504574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:07.507303 np0000000747 nova-compute[97971]: INFO os_vif [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:39:88,bridge_name='br-int',has_traffic_filtering=True,id=d14b0b96-59d7-4fb2-8b83-fb72d95bd884,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd14b0b96-59')
May 14 04:28:07.507575 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Deleting instance files /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d_del
May 14 04:28:07.508403 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Deletion of /opt/stack/data/nova/instances/eb9bb511-c615-4ea8-9fa3-c784c88a680d_del complete
May 14 04:28:07.630191 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:28:07.649202 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:07.722246 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:07.724175 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:07.725339 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1881911355', uuid='09eb687f-f8dd-4062-b883-f2211b86533e'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:0b:98:cf"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732887.725016) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:07.726309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:07.726678 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:07.727406 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:07.727643 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:07.728972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:07.729326 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:07.729502 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:07.729679 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:07.729813 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:07.729895 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:07.729983 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:07.730157 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:07.730252 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:07.730350 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:07.730443 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:07.730540 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:07.730823 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:08.022967 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:28:08.023783 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:28:08.024188 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:28:08.024303 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:28:08.024574 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:08.164944 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:08.221628 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:08.221812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:08.224835 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:08.224961 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Claim successful on node np0000000747
May 14 04:28:08.234733 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:08.252576 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881911355',display_name='tempest-ServerRescueNegativeTestJSON-server-1881911355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1881911355',id=18,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:42Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-fu68neib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:27:42Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=09eb687f-f8dd-4062-b883-f2211b86533e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:0b:98:cf"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:08.253490 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:0b:98:cf"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:08.253823 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:08.254732 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:08.616664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:08.616888 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:08.655513 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:08.762236 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:08.762236 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <uuid>09eb687f-f8dd-4062-b883-f2211b86533e</uuid>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <name>instance-00000012</name>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1881911355</nova:name>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:07</nova:creationTime>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         <nova:port uuid="f9b6dc47-4e62-4b75-845e-2b20f0e068fb">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="serial">09eb687f-f8dd-4062-b883-f2211b86533e</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="uuid">09eb687f-f8dd-4062-b883-f2211b86533e</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config.rescue"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:0b:98:cf"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <target dev="tapf9b6dc47-4e"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/console.log" append="off"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:08.762236 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:08.767963 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance destroyed successfully.
May 14 04:28:09.120077 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:09.237205 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:09.382892 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4cb7723-4561-42e5-8b7a-56c73b8ca1e9 req-8a5b0719-6f8d-4a74-a0e6-88967de82fc4 service nova] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Received event network-vif-deleted-d14b0b96-59d7-4fb2-8b83-fb72d95bd884 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:09.729986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:09.730319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:09.730590 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Attaching volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 to /dev/vdb
May 14 04:28:09.739933 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Took 1.72 seconds to deallocate network for instance.
May 14 04:28:09.795144 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:09.808571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:28:09.832866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:09.878058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:28:09.878513 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:28:09.890438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:28:09.894096 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fef5:a101', 'fe80::888:ecff:fe85:f7c6'] 
May 14 04:28:09.894096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:28:09.894096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:28:09.894096 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:09.894511 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating existing volume attachment record: 1c6677cb-274b-4fa6-b289-2a09cc3a4c78 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:28:09.932537 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:09.933504 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:10.126314 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:10.248787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:10.288698 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:10.288841 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:10.288960 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:10.289125 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:0b:98:cf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:10.289837 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Using config drive
May 14 04:28:10.437662 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:10.486822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:10.487230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:10.487521 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:10.488042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:10.488279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:10.502367 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:10.502890 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:10.503370 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:10.503598 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:10.504001 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:10.504187 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:10.517314 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:10.517314 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:10.523807 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:10.523807 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:10.534194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:10.544559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:10.557371 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:10.558031 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:10.558474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:10.558474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:10.559557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] HCTL ('18', '0', '0', 0) found on session 41 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:10.559751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:10.571487 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:10.571925 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:10.572274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:10.572274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:10.572874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching for a device in session 41 and hctl ('18', '0', '0', 0) yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:10.573350 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:10.574345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] HCTL ('17', '0', '0', 0) found on session 40 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:10.574495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:10.584764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Searching for a device in session 40 and hctl ('17', '0', '0', 0) yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:10.584970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:10.792934 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'ec2_ids' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:10.810934 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:10.947980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.726s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:10.949093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.700s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:10.949328 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:28:11.208550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:11.209273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:11.209273 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Attaching volume 8a6352c2-4cf0-4115-956b-c59259bf46d3 to /dev/vdb
May 14 04:28:11.271047 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:11.286273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:28:11.296581 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:11.296842 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'keypairs' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:11.311878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:11.354384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:28:11.354859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:28:11.363826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:28:11.366055 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fe2f:f0df', 'fe80::2406:10ff:fe26:2f', 'fe80::fc16:3eff:fe7e:968', 'fe80::fc16:3eff:fe1b:4f9e', 'fe80::fc16:3eff:fea2:e044', 'fe80::fc16:3eff:fe8a:1ba3', 'fe80::fc16:3eff:fe3c:ec26', 'fe80::f8d9:17ff:fe4b:ff17', 'fe80::fc16:3eff:fefb:424', 'fe80::fc16:3eff:fedb:647f', 'fe80::6c7e:35ff:fe81:ed8c', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fef5:a101', 'fe80::888:ecff:fe85:f7c6'] 
May 14 04:28:11.366185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:28:11.366307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:28:11.366548 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:11.366944 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating existing volume attachment record: f9241c17-bfd1-4e54-8169-0c9e599b6729 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:28:11.462551 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:28:11.463583 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:28:11.465021 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:11.465307 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:11.505563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:28:11.569532 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:28:11.779489 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:11.779907 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:11.800147 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:11.803483 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:11.943850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:11.944308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:11.944518 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:11.968172 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:28:11.993749 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Creating config drive at /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config.rescue
May 14 04:28:11.998929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3boo4hfr {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:12.061885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3boo4hfr" returned: 0 in 0.063s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:12.243201 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Successfully created port: 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:28:12.287050 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:12.477223 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:28:12.500092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.526231 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found WWN 33000000036e66b10 for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:28:12.526719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:12.527035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] <== connect_volume: return (2039ms) {'type': 'block', 'scsi_wwn': '33000000036e66b10', 'path': '/dev/dm-9', 'multipath_id': '33000000036e66b10'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:12.528925 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000036e66b10', 'path': '/dev/dm-9', 'multipath_id': '33000000036e66b10'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:28:12.529585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.585s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:12.530288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:12.534016 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:12.550805 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:12.551440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:12.552058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:12.552322 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:12.553198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:12.553349 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:12.568294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:12.568294 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:12.579176 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:12.579176 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:12.581316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3] added
May 14 04:28:12.581316 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:12.581316 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:12.581316 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:12.581316 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:12.581316 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:12.581316 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:12.581633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:12.581701 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:12.581872 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:12.593193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3] added
May 14 04:28:12.593193 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:12.593193 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:12.593193 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:12.593193 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:12.593193 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:12.593193 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:12.593706 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:12.593706 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:12.593706 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:12.595069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.604896 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:12.605453 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:12.609782 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:12.610052 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:12.632939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.639235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.737541 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.738927 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:12.798468 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.850s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:12.867341 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Deleted allocations for instance eb9bb511-c615-4ea8-9fa3-c784c88a680d
May 14 04:28:12.896604 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:12.896840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:12.897027 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:12.897176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:12.898011 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:12.899852 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f87041e1-4b82-470c-94e9-04e65d1d2d20 req-2a6f8c71-ef0b-472b-945f-6fb536336fe4 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state rescuing.
May 14 04:28:13.040076 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Attempting to attach volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:28:13.044525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:13.044525 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:28:13.054072 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Successfully updated port: 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:13.497003 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:28:13.498338 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:28:13.498639 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Creating image(s)
May 14 04:28:13.499233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:13.499426 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:13.500029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:13.500793 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:13.505859 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:13.507265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:13.568943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:13.568943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:13.568943 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:13.580148 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 09eb687f-f8dd-4062-b883-f2211b86533e due to new event <LifecycleEvent: 1778732893.5796528, 09eb687f-f8dd-4062-b883-f2211b86533e => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:28:13.580491 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732893.5796528, 09eb687f-f8dd-4062-b883-f2211b86533e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:13.580686 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Resumed (Lifecycle Event)
May 14 04:28:13.585649 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:13.588193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-84928e8f-494a-452b-9876-395d8c406ad3 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:13.600259 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:13.606885 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:13.609526 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:13.609896 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:13.610215 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:13.613079 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:13.613079 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:13.626743 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:13.626743 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.630504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:13.631826 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:13.632874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:13.633352 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:13.637221 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:13.638060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:13.659441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.665774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.702549 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.703330 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.704293 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:13.733364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.095s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:13.735842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:13.770845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.40.100,3260]
May 14 04:28:13.770845 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.40.100,3260] successful.
May 14 04:28:13.770845 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.779206 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.50.100,3260]
May 14 04:28:13.779206 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.50.100,3260] successful.
May 14 04:28:13.779206 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.790447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.798077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:13.826226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk 1073741824" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:13.827566 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:13.827566 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.829339 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.849736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.859946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:13.866486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.308s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:13.866486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:13.866486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] HCTL ('15', '-', '-', 0) found on session 44 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:13.866486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:13.869397 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.315s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] HCTL ('10', '-', '-', 0) found on session 43 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:13.869397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:13.889337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b4bcc9b-d66b-43eb-8fb5-6dba39569d1c tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "eb9bb511-c615-4ea8-9fa3-c784c88a680d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.780s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:13.892146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Searching for a device in session 44 and hctl ['15', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:13.892146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:13.903796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:13.949084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:13.951148 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:28:13.951480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:14.074071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:14.075240 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:28:14.075240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:28:14.075443 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Ensure instance console log exists: /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:28:14.083504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:14.084099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:14.084358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:14.092750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:14.094889 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:14.155728 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:14.346205 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:14.570382 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:14.598427 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732894.5980947, 09eb687f-f8dd-4062-b883-f2211b86533e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:14.598603 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Started (Lifecycle Event)
May 14 04:28:14.609938 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:14.610585 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:14.610777 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:28:14.611116 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:14.767809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:14.768041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:14.768226 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:14.768354 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] No VIF found with MAC fa:16:3e:29:1f:8c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:14.904703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:14.904768 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:14.974398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:14.974585 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing instance network info cache due to event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:14.974787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:15.075717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:15.075969 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance network_info: |[{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:28:15.076473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:15.076763 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:15.079939 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start _get_guest_xml network_info=[{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:15.084083 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:15.086634 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='3370940d-3bd7-45f3-887f-9c515137a348'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732895.0861003) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:15.088352 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:15.089057 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:15.092121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:15.092360 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:15.094237 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:15.094754 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:15.094978 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:15.095103 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:15.095269 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:15.095383 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:15.095520 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:15.095735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:15.095866 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:15.096042 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:15.096176 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:15.096335 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:15.102942 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:15.110502 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:15.120362 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:15.120543 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:15.121225 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:15.121977 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:15.182682 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Unrescuing
May 14 04:28:15.182682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:15.182682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:15.182682 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:15.569121 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Found WWN 3300000006eddcf1f for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:28:15.569402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:15.569628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] <== connect_volume: return (3624ms) {'type': 'block', 'scsi_wwn': '3300000006eddcf1f', 'path': '/dev/dm-1', 'multipath_id': '3300000006eddcf1f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:15.569714 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006eddcf1f', 'path': '/dev/dm-1', 'multipath_id': '3300000006eddcf1f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:28:15.572316 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:15.582432 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:15.610140 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:15.610506 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:15.620441 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 04:28:15.627763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <uuid>3370940d-3bd7-45f3-887f-9c515137a348</uuid>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <name>instance-00000014</name>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-0</nova:name>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:15</nova:creationTime>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         <nova:port uuid="79ffd091-d1b4-40f2-a837-e3aea3edff11">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="serial">3370940d-3bd7-45f3-887f-9c515137a348</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="uuid">3370940d-3bd7-45f3-887f-9c515137a348</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:78:d7:1a"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <target dev="tap79ffd091-d1"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/console.log" append="off"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:15.627763 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:15.629741 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Preparing to wait for external event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:28:15.629741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:15.629741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:15.629741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:15.632552 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:15.632797 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:15.634744 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:15.635035 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:15.636234 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.636234 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:15.636234 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:15.639372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.639742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8008a74c-c676-5b5a-8965-d4ee5e8d32b7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:15.641839 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.641839 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:15.642471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.649430 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.649430 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79ffd091-d1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:15.649430 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79ffd091-d1, col_values=(('qos', UUID('36b0eae6-b3f2-4540-8c49-f745ea1bb705')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:15.649430 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79ffd091-d1, col_values=(('external_ids', {'iface-id': '79ffd091-d1b4-40f2-a837-e3aea3edff11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d7:1a', 'vm-uuid': '3370940d-3bd7-45f3-887f-9c515137a348'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:15.651493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.651493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:15.658097 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.658509 np0000000747 nova-compute[97971]: INFO os_vif [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1')
May 14 04:28:15.685937 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:15.813001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:15.967157 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:16.078718 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Attempting to attach volume 8a6352c2-4cf0-4115-956b-c59259bf46d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:28:16.083550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:   <alias name="ua-8a6352c2-4cf0-4115-956b-c59259bf46d3"/>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:   <serial>8a6352c2-4cf0-4115-956b-c59259bf46d3</serial>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:16.083550 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:28:16.117177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:16.117384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:16.117530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:16.117690 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:28:16.164656 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updated VIF entry in instance network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:16.164656 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:16.174125 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:16.357850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4329b734-7516-430b-881b-0c7a3fb505d9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.627s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:16.365122 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [{"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:16.667224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:16.667671 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:16.667671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:16.667824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:16.668004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:16.668159 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:16.668316 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e9d247e6-517d-443d-a3d3-e9a00c887c38 req-9efecb53-fe84-4168-a1cf-8b0aa703e1b2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state rescued and task_state unrescuing.
May 14 04:28:16.868045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-09eb687f-f8dd-4062-b883-f2211b86533e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:16.868676 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'flavor' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:17.139708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:17.139992 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:17.189646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:17.189646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:17.189646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:78:d7:1a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:17.189646 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Using config drive
May 14 04:28:17.274531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.388280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:17.389585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.423771 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:17.453544 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:17.507642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:17.512593 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:17.519192 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:17.519316 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:17.519764 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:17.595032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.607834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:17.623109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:17.643205 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Detaching volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:17.675069 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:17.677769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:17.677769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:17.677769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:17.677769 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:17.677769 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9c3dc0e7-6c55-4cf4-a97a-0438d2859104 req-d8949167-5c11-4b3d-a7fd-30a2a39de9c2 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state rescued and task_state unrescuing.
May 14 04:28:17.701196 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:17.703823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:17.704289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.732549 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Attempting to driver detach volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 from mountpoint /dev/vdb
May 14 04:28:17.762648 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found disk vdb by alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:17.765822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:17.766827 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998381439000013 future=<Future at 0x7435f84c6ab0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:17.767404 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:17.767649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] No VIF found with MAC fa:16:3e:a5:f7:19, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:17.769157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found disk vdb by alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:17.773145 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Attempting to detach device vdb from instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:28:17.773478 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:17.773478 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:17.774483 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance destroyed successfully.
May 14 04:28:17.777678 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'numa_topology' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:17.782579 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully detached device vdb from instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 from the persistent domain config.
May 14 04:28:17.782847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] (1/8): Attempting to detach device vdb with device alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 from instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:28:17.783242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:17.783242 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:17.822041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk.rescue --force-share --output=json" returned: 0 in 0.117s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:17.823299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.881458 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:17.881852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:17.930535 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Creating config drive at /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config
May 14 04:28:17.934732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmvasnyiw {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.947527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:17.948460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:17.990057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmvasnyiw" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.032340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.044674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:18.131142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.131761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:18.227954 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.228348 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:18.235292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:18.285087 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<09eb687f-f8dd-4062-b883-f2211b86533e> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:18.331220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.331671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:18.386716 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:28:18.413226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:18.547685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732898.547212, 34b571d5-617e-4f48-8368-7bb5fc36bfa2 => ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:18.552055 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 for instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:18.555676 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully detached device vdb from instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 from the live domain config.
May 14 04:28:18.697590 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:18.698127 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:18.698127 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:18.698807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:18.698971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:18.704311 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Terminating instance
May 14 04:28:18.797936 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:18.841930 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:18.847064 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:18.951773 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:18.957709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:18.968645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:18.968645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:18.972227 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:18.972364 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Claim successful on node np0000000747
May 14 04:28:19.025440 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f11db83e-3dc6-4453-98ff-66a545d656b7 req-0c096ce5-a1d8-477a-80f5-94d0b56fd99f service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:19.025886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f11db83e-3dc6-4453-98ff-66a545d656b7 req-0c096ce5-a1d8-477a-80f5-94d0b56fd99f service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:19.026142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f11db83e-3dc6-4453-98ff-66a545d656b7 req-0c096ce5-a1d8-477a-80f5-94d0b56fd99f service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:19.026207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f11db83e-3dc6-4453-98ff-66a545d656b7 req-0c096ce5-a1d8-477a-80f5-94d0b56fd99f service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:19.026344 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f11db83e-3dc6-4453-98ff-66a545d656b7 req-0c096ce5-a1d8-477a-80f5-94d0b56fd99f service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Processing event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:28:19.039884 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.106510 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Detected multiple connections on this host for volume: bce09ffa-f3c3-4d23-aef3-a3335bef8f98, skipping target disconnect.
May 14 04:28:19.211089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:28:19.250378 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.254530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.277448 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.311870 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.346222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.353229 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.371023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bdd4fa2f-814b-4b5f-8ebc-19904c53a98d tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:19.450012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:19.486214 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.530342 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.562574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:19.564521 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:19.603644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:19.611501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:19.611501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:19.611501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:19.611501 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:19.611501 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ca5659f1-f7b1-40d2-85c7-6d891a747690 req-512bdc8f-d52d-4cf8-98e9-9b74c84f9cde service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:19.612000 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.673844 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.688660 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:19.703506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:19.718881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:19.761265 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.859018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.875661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:19.877252 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:19.907601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.927262 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99728354900003 future=<Future at 0x7435f84094f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:19.928668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:19.934170 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Instance destroyed successfully.
May 14 04:28:19.936336 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lazy-loading 'resources' on Instance uuid 4da473ba-6f29-4334-b061-1d1d34f65717 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:19.980284 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.059417 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.059828 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:20.067949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.088786 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.150917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.195948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.197142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.328553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.328825 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:20.333985 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.449063 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.451325 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:20.451325 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.451642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:20.462521 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.463927 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.467840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:20.468158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:20.468464 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:20.469427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.469974 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state rescued and task_state unrescuing.
May 14 04:28:20.470104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:20.470325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:20.470517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:20.470932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:20.471480 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:20.471480 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df5d80c5-7c2b-462e-8a15-37edc1d6c142 req-efa62e4e-59df-4c42-b9b0-5386e145cfb3 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:20.471858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b752b51-97, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.477076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.478759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.507029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.508579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.528320 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.017218204000073456 future=<Future at 0x7435f84b32c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:20.531082 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:20.531445 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.4455424980001226 future=<Future at 0x7435f8338950 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:20.532455 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.4453264179999223 future=<Future at 0x7435f8338950 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:20.534936 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.553749 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.554293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98f53217-c509-494e-abdd-5d18597bfa63) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.561716 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.565566 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.593373 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732900.5928547, 3370940d-3bd7-45f3-887f-9c515137a348 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:20.595697 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Started (Lifecycle Event)
May 14 04:28:20.600394 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.603156 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:28:20.606493 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f0:df,bridge_name='br-int',has_traffic_filtering=True,id=0b752b51-9720-4646-9cc2-bf7aa483b3a0,network=Network(f40a14dc-cc83-4099-91fb-fb0c9911bf93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b752b51-97')
May 14 04:28:20.607403 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.607594 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.608426 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.608745 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.615878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.616311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12868c4f-d9, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.618182 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.619545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:28:20.623075 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.633424 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance spawned successfully.
May 14 04:28:20.634060 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:28:20.651451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.654720 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.685731 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.696656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.697155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=910bc0e5-cf87-4d66-bd64-20aa681b2f49) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.698282 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.699257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.728254 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ea6d4e28-2348-4b1f-adf7-3f7b0a079348 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:20.728935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.734780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b01882c-08ac-4f1e-a952-03a94274be0d tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.594s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:20.737673 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:09:68,bridge_name='br-int',has_traffic_filtering=True,id=12868c4f-d9e7-4d6c-80bb-07382344b782,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12868c4f-d9')
May 14 04:28:20.739209 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.744987 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.745745 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.746166 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.754376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.755913 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5957b670-2b, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.758590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.760144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.785785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.791875 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.793287 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8cce7b9-38d0-41d4-8cb0-85ada5220656) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.795392 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.795981 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.796678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.797433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.823302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.834152 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5957b670-2b91-4059-9b2b-6ff7707d41d9,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5957b670-2b')
May 14 04:28:20.836257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.836257 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.837202 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.838237 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.840806 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.841073 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94f74dab-b8, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.845777 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.846958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.861092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.862695 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.863494 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6804fd9c-2fe3-4c1c-907a-36e167c3ba35) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.864398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.864993 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.885345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.890578 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e0:44,bridge_name='br-int',has_traffic_filtering=True,id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f74dab-b8')
May 14 04:28:20.891737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.892185 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.893976 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.895149 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.895907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.897048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2103083d-c3, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.900967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:20.901373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.903398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.904070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:20.922001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.929803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.929803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4426f726-b05d-4171-b916-6237e58634df) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.931211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.932937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.947808 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.952712 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1b:a3,bridge_name='br-int',has_traffic_filtering=True,id=2103083d-c391-40bf-8a73-79aea110acb4,network=Network(b31cb3e0-9b31-495d-b16f-8460a2e82b07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2103083d-c3')
May 14 04:28:20.953002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.953231 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.955222 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.955810 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.959083 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.959302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdfb3b0-76, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.960919 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.962121 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.968081 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.969499 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.969672 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ee3e962-abbd-4b53-838d-4dd266c64857) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.970174 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.970693 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.981219 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.983936 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ec:26,bridge_name='br-int',has_traffic_filtering=True,id=2bdfb3b0-76cc-4c8f-8737-04b5c6682806,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfb3b0-76')
May 14 04:28:20.986587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697871458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1697871458',id=10,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTdOVbC4t/jgL8ybVFQcZyHFqy6HrrzKeblRDX8mc0ZRRw7tdvTR4tn+kKtkRKe+SZml/8hHFLkZFiLotPWIXkZK2Rg8Yddhg6kzBWIEmxUR2+lU+RR7FhFZLefCFEZfw==',key_name='tempest-keypair-1589388163',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93dd24bcdb5043d9b23426bea16778cb',ramdisk_id='',reservation_id='r-0kfn4tg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-986832132',owner_user_name='tempest-TaggedBootDevicesTest-986832132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880be5c4e79e4884bf63d220ef7cfd04',uuid=4da473ba-6f29-4334-b061-1d1d34f65717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:20.987867 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converting VIF {"id": "ce562d2b-9682-4f0d-a82a-4061d061deec", "address": "fa:16:3e:fb:04:24", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce562d2b-96", "ovs_interfaceid": "ce562d2b-9682-4f0d-a82a-4061d061deec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:20.989519 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:20.990121 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:20.992916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.993176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce562d2b-96, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:20.995411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:20.997803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:20.999184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:21.000067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41042e5e-506e-437e-bdbb-82762523e76e) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:21.000980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:21.001541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:21.001947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:21.002817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:21.025001 np0000000747 nova-compute[97971]: INFO os_vif [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:24,bridge_name='br-int',has_traffic_filtering=True,id=ce562d2b-9682-4f0d-a82a-4061d061deec,network=Network(eeee0e2b-de7d-4e61-8159-6c633490c94e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce562d2b-96')
May 14 04:28:21.033040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:21.034054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:21.034410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:21.036347 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:21.037482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:21.038113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.091123 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.095059 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:21.096120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '44')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:21.096120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '22')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.102695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb', '23')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.102695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e3c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:21.102695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:21.102695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Flush multipath device 330000000102c8030 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:21.104238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:21.106651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:21.111039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:21.114249 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:21.115545 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:21.165552 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:28:21.170787 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732901.1702664, 3370940d-3bd7-45f3-887f-9c515137a348 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:21.170911 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Paused (Lifecycle Event)
May 14 04:28:21.174671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:21.180800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:21.185439 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=11050MB free_disk=73.28495407104492GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:28:21.185892 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.192719 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.201651 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.202073 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.202445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.203680 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.203837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.204151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.204312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.204629 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] No waiting events found dispatching network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.205009 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received unexpected event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 for instance with vm_state building and task_state spawning.
May 14 04:28:21.205311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.205711 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:21.209472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.211282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.211282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.211282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.212763 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.213626 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.214323 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.216350 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.216528 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.216769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.216959 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.217073 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-ce562d2b-9682-4f0d-a82a-4061d061deec for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.217203 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.217348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.217515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.217598 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.217724 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.217836 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.217948 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.218090 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.218188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.218339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.218403 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.218478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0888d306-8867-4335-bfbf-9637dad25f80 req-93c14275-5d0e-414b-94e6-1ccaebb56736 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.230760 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:21.277327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:21.277545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:21.280378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:21.282018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.286635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.302236 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:21.302647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:21.316494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.358375 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:21.358628 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:21.361239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.40.100,3260]
May 14 04:28:21.361239 np0000000747 nova-compute[97971]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.40.100,3260] successful.
May 14 04:28:21.361239 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.386095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.408130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.457221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.50.100,3260]
May 14 04:28:21.457221 np0000000747 nova-compute[97971]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-30c2f68f-3115-4040-9e7e-9f3f1d87fbbb, portal: 192.168.50.100,3260] successful.
May 14 04:28:21.457221 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.481128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.481458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:21.481589 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== disconnect_volume: return (446ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:21.481764 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:21.486401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.519188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.519638 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:21.519638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '44')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:21.519999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '25')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.521005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21', '24')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.522299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618321800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:21.522512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:21.522849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Flush multipath device 3300000001dc6bb10 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:21.553667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:21.589973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:21.637964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:21.637964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:21.637964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:21.653161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:21.653366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:21.670925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.687787 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:21.689351 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732901.689148, 3370940d-3bd7-45f3-887f-9c515137a348 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:21.689519 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Resumed (Lifecycle Event)
May 14 04:28:21.699740 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.699740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.699740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.699740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.700116 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.700116 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-0b752b51-9720-4646-9cc2-bf7aa483b3a0 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.700279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.700316 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.700525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.701027 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.701027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.701027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.701027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:21.701835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.701908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.702065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:21.702410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:21.702663 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa4379ff-7f21-4c70-9cd9-f4f07b8fe2d2 req-51b61c53-a9eb-4e88-8ca1-b662c5a752c9 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-12868c4f-d9e7-4d6c-80bb-07382344b782 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:21.722985 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Took 8.23 seconds to spawn the instance on the hypervisor.
May 14 04:28:21.723137 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:21.725741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.40.100,3260]
May 14 04:28:21.725741 np0000000747 nova-compute[97971]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.40.100,3260] successful.
May 14 04:28:21.725741 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.754359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.772184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.790789 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Detaching volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98
May 14 04:28:21.818855 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.50.100,3260]
May 14 04:28:21.818855 np0000000747 nova-compute[97971]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-5a8a54d2-9207-45f3-9d16-8b73a48a5e21, portal: 192.168.50.100,3260] successful.
May 14 04:28:21.818855 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.847805 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:21.849785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:21.849785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== disconnect_volume: return (363ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:21.849785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:21.852115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:21.852296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:21.852843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:21.853301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:21.854690 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e17f69b-e90f-4c84-a87e-091ca8b44aad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:21.855007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:21.866993 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:21.881990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:21.883504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:21.886985 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Attempting to driver detach volume bce09ffa-f3c3-4d23-aef3-a3335bef8f98 from mountpoint /dev/vdb
May 14 04:28:21.899678 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found disk vdb by alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:21.905486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Found disk vdb by alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:21.905486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Attempting to detach device vdb from instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:28:21.905486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:21.905486 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.916694 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:21.917257 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:21.918874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1f9eb3c9-f19c-4da9-b75f-15267fa689c2', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '44')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:21.918874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '31')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.925830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad', '30')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:21.928032 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b4ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'): ({'sdn'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:21.928481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Removing multipathed devices sdn, sdo {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:21.929227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Flush multipath device 330000000fd324428 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:21.930723 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully detached device vdb from instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 from the persistent domain config.
May 14 04:28:21.931323 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] (1/8): Attempting to detach device vdb with device alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 from instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:28:21.931587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <alias name="ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98"/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <serial>bce09ffa-f3c3-4d23-aef3-a3335bef8f98</serial>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:21.931587 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:21.971933 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:21.979287 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0021093529999234306 future=<Future at 0x7435f8338950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:21.979420 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:21.980303 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.785613643000033 future=<Future at 0x7435f84c6ab0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:21.980475 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.784724860000097 future=<Future at 0x7435f84c6ab0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:21.981299 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778732886.976803, eb9bb511-c615-4ea8-9fa3-c784c88a680d => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:21.981433 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] VM Stopped (Lifecycle Event)
May 14 04:28:22.026103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:22.069632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:22.069806 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:22.070966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:22.083602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:22.083809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:22.096385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.131150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.40.100,3260]
May 14 04:28:22.131150 np0000000747 nova-compute[97971]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.40.100,3260] successful.
May 14 04:28:22.131150 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.151829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.164450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.191869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:22.194597 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:22.199261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.50.100,3260]
May 14 04:28:22.199261 np0000000747 nova-compute[97971]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-2e17f69b-e90f-4c84-a87e-091ca8b44aad, portal: 192.168.50.100,3260] successful.
May 14 04:28:22.199261 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.220155 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:22.220354 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:22.220490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] <== disconnect_volume: return (367ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:22.220636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:22.220971 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Deleting instance files /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717_del
May 14 04:28:22.221559 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Deletion of /opt/stack/data/nova/instances/4da473ba-6f29-4334-b061-1d1d34f65717_del complete
May 14 04:28:22.236062 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Took 14.10 seconds to build instance.
May 14 04:28:22.383868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.416s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.384624 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.198s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.385790 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:28:22.392540 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Detaching volume 8a6352c2-4cf0-4115-956b-c59259bf46d3
May 14 04:28:22.442344 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Attempting to driver detach volume 8a6352c2-4cf0-4115-956b-c59259bf46d3 from mountpoint /dev/vdb
May 14 04:28:22.451019 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Found disk vdb by alias ua-8a6352c2-4cf0-4115-956b-c59259bf46d3 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:22.454303 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Found disk vdb by alias ua-8a6352c2-4cf0-4115-956b-c59259bf46d3 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:28:22.454431 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Attempting to detach device vdb from instance c249f70f-670b-4f62-adad-6093dc284b23 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:28:22.454714 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <alias name="ua-8a6352c2-4cf0-4115-956b-c59259bf46d3"/>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <serial>8a6352c2-4cf0-4115-956b-c59259bf46d3</serial>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:22.454714 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:22.461748 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully detached device vdb from instance c249f70f-670b-4f62-adad-6093dc284b23 from the persistent domain config.
May 14 04:28:22.461940 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] (1/8): Attempting to detach device vdb with device alias ua-8a6352c2-4cf0-4115-956b-c59259bf46d3 from instance c249f70f-670b-4f62-adad-6093dc284b23 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:28:22.462203 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <alias name="ua-8a6352c2-4cf0-4115-956b-c59259bf46d3"/>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <serial>8a6352c2-4cf0-4115-956b-c59259bf46d3</serial>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:22.462203 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:22.486319 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: eb9bb511-c615-4ea8-9fa3-c784c88a680d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:22.510752 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.510956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.511339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.511982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.512376 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.512540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-5957b670-2b91-4059-9b2b-6ff7707d41d9 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:22.512715 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.512906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.513213 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.513442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.513638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.513768 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:22.513895 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.514075 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.514234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.514553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.514721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.514838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-2103083d-c391-40bf-8a73-79aea110acb4 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:22.515027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.515112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.515255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.515451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.515451 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.515727 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:22.515727 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.515851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.515962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.516049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "4da473ba-6f29-4334-b061-1d1d34f65717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.516172 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] No waiting events found dispatching network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.516275 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-unplugged-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:22.516364 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.516509 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.516650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.516741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.516850 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.516988 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state None.
May 14 04:28:22.517089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:22.517209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:22.517333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:22.517423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.517511 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:22.517609 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-feb2a28d-c895-43b6-9495-4558346917a8 req-70db78e0-3cb7-42d0-badf-6ce4aa6eeb63 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received unexpected event network-vif-plugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with vm_state active and task_state None.
May 14 04:28:22.697191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 09eb687f-f8dd-4062-b883-f2211b86533e due to new event <LifecycleEvent: 1778732902.696831, 09eb687f-f8dd-4062-b883-f2211b86533e => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:28:22.697399 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732902.696831, 09eb687f-f8dd-4062-b883-f2211b86533e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:22.697511 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Resumed (Lifecycle Event)
May 14 04:28:22.732207 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Took 3.52 seconds to destroy the instance on the hypervisor.
May 14 04:28:22.732685 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:28:22.733075 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:28:22.733167 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:28:22.733493 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:22.737437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.610s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:22.831114 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:22.892598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:28:22.893962 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:28:22.894229 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:22.902781 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:23.016477 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8ede1ead104b17957a4b8b20b80d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6680b6e8f4e4852b7d9bb1f67e84fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:28:23.039455 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8a6352c2-4cf0-4115-956b-c59259bf46d3 for instance c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:23.202837 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:23.207428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:23.394858 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:28:23.498046 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498192 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4da473ba-6f29-4334-b061-1d1d34f65717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498341 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498458 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498578 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498704 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498800 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance c249f70f-670b-4f62-adad-6093dc284b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.498893 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5d42ebce-6d76-4893-b335-bceb7181a83a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.499005 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 09eb687f-f8dd-4062-b883-f2211b86533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.499080 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.499150 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3370940d-3bd7-45f3-887f-9c515137a348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.499230 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ec7eb127-aa14-4632-aadd-d50696b45625 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:28:23.499469 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:28:23.499630 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:28:21 up 28 min,  2 users,  load average: 10.35, 6.01, 2.79\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '11', 'num_os_type_None': '12', 'num_proj_c6680b6e8f4e4852b7d9bb1f67e84fe6': '2', 'io_workload': '1', 'num_task_deleting': '1', 'num_proj_93dd24bcdb5043d9b23426bea16778cb': '1', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '4', 'num_proj_d09c55a931624a709a3721d199eecd5f': '2', 'num_proj_781e2f73cfe2496391efde04eee02a9e': '1', 'num_proj_cfaef82fed39403a80c7ec4baa8ad091': '2', 'num_vm_rescued': '1', 'num_vm_building': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:28:23.716377 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732903.7160482, 09eb687f-f8dd-4062-b883-f2211b86533e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:23.716536 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Started (Lifecycle Event)
May 14 04:28:23.898396 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Successfully created port: d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:28:23.901249 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:28:24.219560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:24.226896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:24.357103 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:24.357608 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:24.407297 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Booting with volume 90ebb94c-0b74-48de-ba06-6488816ef98b at /dev/vda
May 14 04:28:24.480591 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:24.496483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:28:24.513160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:24.528372 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:24.565156 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 for instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:24.585655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:28:24.586242 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:28:24.602119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:28:24.609548 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:24.610256 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing instance network info cache due to event network-changed-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:24.612047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Acquiring lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:24.612494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Acquired lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:24.612800 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Refreshing network info cache for port e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:24.616266 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:feef:36e4', 'fe80::c86e:35ff:fe42:2a15', 'fe80::fc16:3eff:fe29:1f8c', 'fe80::fc16:3eff:fea5:f719', 'fe80::609c:f1ff:fe4c:14dc', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fef5:a101', 'fe80::888:ecff:fe85:f7c6', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe0b:98cf'] 
May 14 04:28:24.616416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:28:24.617059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:28:24.620088 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:24.620305 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating existing volume attachment record: ab08ab5f-6aff-483c-af94-4b4058827c8a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:28:24.637323 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Successfully updated port: d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:24.730525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732904.7301226, c249f70f-670b-4f62-adad-6093dc284b23 => ua-8a6352c2-4cf0-4115-956b-c59259bf46d3> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:24.730750 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732904.7305534, 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 => ua-bce09ffa-f3c3-4d23-aef3-a3335bef8f98> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:24.736441 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully detached device vdb from instance c249f70f-670b-4f62-adad-6093dc284b23 from the live domain config.
May 14 04:28:24.739403 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully detached device vdb from instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 from the live domain config.
May 14 04:28:24.740142 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:24.740701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:24.740909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:24.741871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:24.742674 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8a6352c2-4cf0-4115-956b-c59259bf46d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:24.743808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:24.776792 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3 (non-flash)
May 14 04:28:24.777072 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:24.777319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '44')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:24.777319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '43')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:24.778141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3', '44')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:24.778867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b6840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:24.779077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Removing multipathed devices sde, sdj {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:24.779484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Flush multipath device 3300000006eddcf1f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:24.791659 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:24.793268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:24.794458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:24.809363 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:24.850653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:24.863131 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:24.910637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Checking to see if SCSI volumes sde, sdj have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:24.910637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] SCSI volumes sde, sdj have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:24.914761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Checking to see if device paths {'sde', 'sdj'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:24.932796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Device paths {'sde', 'sdj'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:24.933176 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:24.946128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:24.983926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.40.100,3260]
May 14 04:28:24.983926 np0000000747 nova-compute[97971]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.40.100,3260] successful.
May 14 04:28:24.983926 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.002195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.024154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.071144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.50.100,3260]
May 14 04:28:25.071144 np0000000747 nova-compute[97971]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-8a6352c2-4cf0-4115-956b-c59259bf46d3, portal: 192.168.50.100,3260] successful.
May 14 04:28:25.071144 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.088992 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.089283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:25.089481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] <== disconnect_volume: return (348ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:25.091392 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:25.091588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.297s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:25.093785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:25.094102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:25.120579 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98 (non-flash)
May 14 04:28:25.124188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:25.124188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '41')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:25.124765 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98', '40')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:25.128648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bf94680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'): ({'sdm'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:25.128648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Removing multipathed devices sdm, sdl {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:25.128648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Flush multipath device 33000000036e66b10 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:25.141224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:25.141427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:25.141669 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:25.166679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:25.202796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:25.253951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:25.254129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:25.255554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:25.271438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:25.280747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:25.291602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.327356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.40.100,3260]
May 14 04:28:25.327356 np0000000747 nova-compute[97971]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.40.100,3260] successful.
May 14 04:28:25.327356 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.342044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.361721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.376210 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:28:25.376912 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.992s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:25.377404 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:25.393995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.50.100,3260]
May 14 04:28:25.393995 np0000000747 nova-compute[97971]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-bce09ffa-f3c3-4d23-aef3-a3335bef8f98, portal: 192.168.50.100,3260] successful.
May 14 04:28:25.393995 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.407578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:25.407930 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:25.408108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] <== disconnect_volume: return (614ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:25.408273 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:25.529014 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:25.613902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:25.614113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:25.645176 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2240a96d-f87c-459c-b342-95254fb17afe req-8cb90678-c13c-415d-9420-dfdd313ce8fe service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-deleted-ce562d2b-9682-4f0d-a82a-4061d061deec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:25.650782 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-2240a96d-f87c-459c-b342-95254fb17afe req-8cb90678-c13c-415d-9420-dfdd313ce8fe service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Neutron deleted interface ce562d2b-9682-4f0d-a82a-4061d061deec; detaching it from the instance and deleting it from the info cache
May 14 04:28:25.651488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2240a96d-f87c-459c-b342-95254fb17afe req-8cb90678-c13c-415d-9420-dfdd313ce8fe service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:25.673568 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:25.738509 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updated VIF entry in instance network info cache for port e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:25.742451 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [{"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:25.745243 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:25.825045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:25.946897 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:25.987287 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'flavor' on Instance uuid 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:26.002047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:26.109915 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:26.117221 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:28:26.157444 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2240a96d-f87c-459c-b342-95254fb17afe req-8cb90678-c13c-415d-9420-dfdd313ce8fe service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Detach interface failed, port_id=ce562d2b-9682-4f0d-a82a-4061d061deec, reason: Instance 4da473ba-6f29-4334-b061-1d1d34f65717 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:26.252006 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Releasing lock "refresh_cache-5d42ebce-6d76-4893-b335-bceb7181a83a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:26.252192 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:26.252425 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing instance network info cache due to event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:26.252597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:26.252740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:26.252877 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:26.542950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:26.543184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:26.611912 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:26.612200 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance network_info: |[{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:28:26.696373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:26.696683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:26.707576 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:26.710716 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Claim successful on node np0000000747
May 14 04:28:26.715406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4d29f9f5-43ef-4ab0-87e3-82ebb4d18189 req-940c176c-81e0-4042-ace6-a9bb8b9e26fb service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-deleted-94f74dab-b8f0-4b58-b8e9-f291299ec4c0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:26.723869 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-4d29f9f5-43ef-4ab0-87e3-82ebb4d18189 req-940c176c-81e0-4042-ace6-a9bb8b9e26fb service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Neutron deleted interface 94f74dab-b8f0-4b58-b8e9-f291299ec4c0; detaching it from the instance and deleting it from the info cache
May 14 04:28:26.723869 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4d29f9f5-43ef-4ab0-87e3-82ebb4d18189 req-940c176c-81e0-4042-ace6-a9bb8b9e26fb service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2103083d-c391-40bf-8a73-79aea110acb4", "address": "fa:16:3e:8a:1b:a3", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2103083d-c3", "ovs_interfaceid": "2103083d-c391-40bf-8a73-79aea110acb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:26.725587 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-changed-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:26.725765 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Refreshing instance network info cache due to event network-changed-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:26.725932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:26.726054 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:26.726630 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Refreshing network info cache for port d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:26.757026 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:28:26.760686 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:28:26.761378 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:26.764392 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Creating image(s)
May 14 04:28:26.765003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:28:26.765146 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Ensure instance console log exists: /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:28:26.766442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:26.766755 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:26.767141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:26.768003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start _get_guest_xml network_info=[{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ab08ab5f-6aff-483c-af94-4b4058827c8a', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ec7eb127-aa14-4632-aadd-d50696b45625', 'attached_at': '', 'detached_at': '', 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'serial': '90ebb94c-0b74-48de-ba06-6488816ef98b'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:26.770439 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:26.772313 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1210740464', uuid='ec7eb127-aa14-4632-aadd-d50696b45625'), owner=OwnerMeta(userid='5a8ede1ead104b17957a4b8b20b80d6b', username='tempest-ServerActionsTestOtherA-1166153365-project-member', projectid='c6680b6e8f4e4852b7d9bb1f67e84fe6', projectname='tempest-ServerActionsTestOtherA-1166153365'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732906.7718854) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:26.773660 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:26.774098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:26.775107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:26.775337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:26.776513 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:26.776949 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:26.777111 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:26.777249 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:26.777412 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:26.777544 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:26.777729 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:26.777948 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:26.778104 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:26.778252 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:26.778404 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:26.778566 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:26.793173 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:26.793677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:26.793882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:26.794662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:26.795013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:26.812508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:26.813105 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:26.813655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:26.813877 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:26.814223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:26.814439 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:26.827008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:26.827008 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:26.838535 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:26.838535 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:26.852245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b] added
May 14 04:28:26.852245 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:26.852245 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:26.852245 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:26.852245 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:26.852245 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:26.852245 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:26.852562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:26.852904 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:26.852904 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:26.853752 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b] added
May 14 04:28:26.853752 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:26.853752 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:26.853752 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:26.853752 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:26.853752 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:26.853752 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:26.854131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:26.854315 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:26.854499 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:26.996154 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4954a07b-10a3-4424-bca4-d8d97d9fc9fe tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.710s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:27.045552 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:28:27.139464 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:27.184416 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:27.187385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-469ea643-5ce0-4f0b-a5f1-0193b92fce52 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.305s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:27.231071 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:27.241560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-4b63c1ee-11b8-42bd-8dff-fa978bc85a65" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.241944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-4b63c1ee-11b8-42bd-8dff-fa978bc85a65" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:27.244721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4d29f9f5-43ef-4ab0-87e3-82ebb4d18189 req-940c176c-81e0-4042-ace6-a9bb8b9e26fb service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Detach interface failed, port_id=94f74dab-b8f0-4b58-b8e9-f291299ec4c0, reason: Instance 4da473ba-6f29-4334-b061-1d1d34f65717 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:27.377120 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:28:27.379009 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.23 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:27.400641 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updated VIF entry in instance network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:27.400983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:27.614288 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:27.632073 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.641039 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Took 4.91 seconds to deallocate network for instance.
May 14 04:28:27.709524 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-00a82111-9fe1-4526-9016-20f77b24cb07 req-1df6b28d-20e2-4669-9319-a9c584e0d028 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-deleted-2bdfb3b0-76cc-4c8f-8737-04b5c6682806 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:27.710139 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-00a82111-9fe1-4526-9016-20f77b24cb07 req-1df6b28d-20e2-4669-9319-a9c584e0d028 service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-deleted-0b752b51-9720-4646-9cc2-bf7aa483b3a0 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:27.750731 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:27.776780 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updated VIF entry in instance network info cache for port d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:27.777130 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:27.829589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.829780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:27.829996 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.830120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:27.830245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:27.832633 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Terminating instance
May 14 04:28:27.855042 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:27.855627 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:27.871109 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:27.871109 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:27.879053 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:27.879053 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.887238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.895717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.900875 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.900875 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.900875 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:27.901183 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.901183 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.901183 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:27.905568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3924b703-c6f2-40dc-ae3c-0d64f855df18 req-95b61f04-04af-4562-99f5-767c970f8902 service nova] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:27.908681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.908681 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.908681 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:27.908681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.908681 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.908681 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:27.934925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.935462 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:27.936269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:27.936269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:27.936498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:27.940548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260]
May 14 04:28:27.940548 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260] successful.
May 14 04:28:27.940548 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.942388 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Terminating instance
May 14 04:28:27.952773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260]
May 14 04:28:27.952773 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260] successful.
May 14 04:28:27.952773 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.954612 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.970226 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.977248 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:27.977742 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:27.977920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:27.978495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('7', '-', '-', 0) found on session 45 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:27.978695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:27.985868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.985868 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.985868 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.985868 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.985868 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:27.986083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.986083 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:27.986083 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.986083 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:27.986083 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:27.986413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:27.986576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:27.987455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('8', '-', '-', 0) found on session 46 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:27.987608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:28.015282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 45 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:28.015282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:28.015282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:28.015282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:28.255006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:28.256008 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:28.258113 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:28.262112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:28.263269 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:28.265479 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Attempting to detach device tap4b63c1ee-11 from instance c249f70f-670b-4f62-adad-6093dc284b23 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:28:28.265824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] detach device xml: <interface type="ethernet">
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:   <mac address="fa:16:3e:f5:a1:01"/>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:   <model type="virtio"/>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:   <driver name="qemu"/>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:   <mtu size="1372"/>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:   <target dev="tap4b63c1ee-11"/>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]: </interface>
May 14 04:28:28.265824 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:28.276457 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:28.281911 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:28.282666 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Received event network-vif-deleted-2103083d-c391-40bf-8a73-79aea110acb4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:28.282666 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Neutron deleted interface 2103083d-c391-40bf-8a73-79aea110acb4; detaching it from the instance and deleting it from the info cache
May 14 04:28:28.283514 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Updating instance_info_cache with network_info: [{"id": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "address": "fa:16:3e:2f:f0:df", "network": {"id": "f40a14dc-cc83-4099-91fb-fb0c9911bf93", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1395149338-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b752b51-97", "ovs_interfaceid": "0b752b51-9720-4646-9cc2-bf7aa483b3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12868c4f-d9e7-4d6c-80bb-07382344b782", "address": "fa:16:3e:7e:09:68", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12868c4f-d9", "ovs_interfaceid": "12868c4f-d9e7-4d6c-80bb-07382344b782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "address": "fa:16:3e:1b:4f:9e", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5957b670-2b", "ovs_interfaceid": "5957b670-2b91-4059-9b2b-6ff7707d41d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "address": "fa:16:3e:a2:e0:44", "network": {"id": "b31cb3e0-9b31-495d-b16f-8460a2e82b07", "bridge": "br-int", "label": "tempest-device-tagging-net1-388558524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f74dab-b8", "ovs_interfaceid": "94f74dab-b8f0-4b58-b8e9-f291299ec4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "address": "fa:16:3e:3c:ec:26", "network": {"id": "eeee0e2b-de7d-4e61-8159-6c633490c94e", "bridge": "br-int", "label": "tempest-device-tagging-net2-2069031920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93dd24bcdb5043d9b23426bea16778cb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfb3b0-76", "ovs_interfaceid": "2bdfb3b0-76cc-4c8f-8737-04b5c6682806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:28.285775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface>not found in domain: <domain type='qemu' id='20'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <name>instance-00000010</name>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <uuid>c249f70f-670b-4f62-adad-6093dc284b23</uuid>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:06</nova:creationTime>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <nova:port uuid="4b63c1ee-11b8-42bd-8dff-fa978bc85a65">
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <memory unit='KiB'>196608</memory>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <vcpu placement='static'>1</vcpu>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <resource>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <partition>/machine</partition>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </resource>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <sysinfo type='smbios'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='product'>OpenStack Nova</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='version'>33.1.0</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='serial'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='uuid'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <entry name='family'>Virtual Machine</entry>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <boot dev='hd'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <smbios mode='sysinfo'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <vmcoreinfo state='on'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <cpu mode='custom' match='exact' check='full'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <model fallback='forbid'>Nehalem</model>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <feature policy='require' name='hypervisor'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <clock offset='utc'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <on_poweroff>destroy</on_poweroff>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <on_reboot>restart</on_reboot>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <on_crash>destroy</on_crash>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <disk type='file' device='disk'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk' index='2'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <backingStore type='file' index='3'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:         <format type='raw'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:         <source file='/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:         <backingStore/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       </backingStore>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target dev='vda' bus='virtio'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='virtio-disk0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <disk type='file' device='cdrom'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <driver name='qemu' type='raw' cache='none'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config' index='1'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <backingStore/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target dev='hda' bus='ide'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <readonly/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='ide0-0-0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <controller type='usb' index='0' model='none'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='usb'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <controller type='pci' index='0' model='pci-root'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='pci.0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <controller type='ide' index='0'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='ide'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <interface type='ethernet'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <mac address='fa:16:3e:a5:f7:19'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target dev='tap7928820e-0a'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <model type='virtio'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <driver name='qemu'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <mtu size='1372'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='net0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <interface type='ethernet'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <mac address='fa:16:3e:f5:a1:01'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target dev='tap4b63c1ee-11'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <model type='virtio'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <driver name='qemu'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <mtu size='1372'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='net1'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <serial type='pty'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target type='isa-serial' port='0'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:         <model name='isa-serial'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       </target>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <console type='pty' tty='/dev/pts/7'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <target type='serial' port='0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </console>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <input type='mouse' bus='ps2'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='input0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <input type='keyboard' bus='ps2'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='input1'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <listen type='address' address='0.0.0.0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <audio id='1' type='none'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <model type='virtio' heads='1' primary='yes'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='video0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <stats period='10'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='balloon0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <rng model='virtio'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <backend model='random'>/dev/urandom</backend>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <alias name='rng0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <label>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</label>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <imagelabel>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</imagelabel>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <label>+64055:+993</label>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:     <imagelabel>+64055:+993</imagelabel>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:28.285775 np0000000747 nova-compute[97971]:  {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 04:28:28.291509 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully detached device tap4b63c1ee-11 from instance c249f70f-670b-4f62-adad-6093dc284b23 from the persistent domain config.
May 14 04:28:28.291509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] (1/8): Attempting to detach device tap4b63c1ee-11 with device alias net1 from instance c249f70f-670b-4f62-adad-6093dc284b23 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:28:28.291509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] detach device xml: <interface type="ethernet">
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:   <mac address="fa:16:3e:f5:a1:01"/>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:   <model type="virtio"/>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:   <driver name="qemu"/>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:   <mtu size="1372"/>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:   <target dev="tap4b63c1ee-11"/>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]: </interface>
May 14 04:28:28.291509 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:28:28.336908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:28:28.364633 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.366896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.399037 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.451830 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:28:28.488606 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.504814 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.525417 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.558001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.567063 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.593983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.634929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.634929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.794949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a245283b-e4cb-4d36-91b8-8428e89fef89 req-af508d85-f47b-4b59-8382-7bb4bf47a9ac service nova] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Detach interface failed, port_id=2103083d-c391-40bf-8a73-79aea110acb4, reason: Instance 4da473ba-6f29-4334-b061-1d1d34f65717 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:28.820683 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:28.821563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:28.822685 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:28.822685 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:28.822685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] No waiting events found dispatching network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:28.822685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1ec113ab-a6dc-4716-aea2-42682e3273ed req-c4101404-e3d5-4833-ac65-fecb7093292d service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:28.823211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:28:28.837548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:28.837763 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:28.842585 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.858745 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999643731000106 future=<Future at 0x7435f8456b10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:28.883421 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.892822 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999722477999967 future=<Future at 0x7435f85eecf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:28.893769 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed17f2df-b6b0-4eae-bb18-e1c93a3ce916 req-a4330ef3-34e1-4215-9360-27771999e7eb service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Instance destroyed successfully.
May 14 04:28:28.901684 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'resources' on Instance uuid 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:28.905744 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Instance destroyed successfully.
May 14 04:28:28.911594 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lazy-loading 'resources' on Instance uuid 34b571d5-617e-4f48-8368-7bb5fc36bfa2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:28.917610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.259656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.278591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.281042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.311134 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.324396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.344263 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:29.389832 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Took 1.75 seconds to detach 3 volumes for instance.
May 14 04:28:29.410532 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-1',id=14,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:14Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:29.411017 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "address": "fa:16:3e:ef:36:e4", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6c2eff-a4", "ovs_interfaceid": "ba6c2eff-a446-4a05-b7e7-8c029f9d431c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:29.412524 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:29.413275 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:29.415152 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-443863854-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testmultiattachvolumeswap-server-443863854-2',id=15,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKgna/Rj2knERYl3RRI+rECOLp8YuVSK/nXgcwmxJPl9ZIGi8DBEljFoKHAVSAUmFKNf9LR4pFhu55jEl0lbDJRmyFgXGKqeO31HTeI3c3c7bIkq6azlY7tTUc1GGrOhQ==',key_name='tempest-keypair-1087133019',keypairs=<?>,launch_index=1,launched_at=2026-05-14T04:27:16Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d09c55a931624a709a3721d199eecd5f',ramdisk_id='',reservation_id='r-bggou2pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1644439510',owner_user_name='tempest-TestMultiAttachVolumeSwap-1644439510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6f5bedbcf3d461b89449de1f1ed3f71',uuid=34b571d5-617e-4f48-8368-7bb5fc36bfa2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:29.415577 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converting VIF {"id": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "address": "fa:16:3e:29:1f:8c", "network": {"id": "fa2c30e4-28c7-4629-b2ca-c236dd1de745", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-2107462124-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d09c55a931624a709a3721d199eecd5f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656ba-47", "ovs_interfaceid": "08d656ba-4789-4687-9c3a-eaaf2593b3dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:29.416457 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:29.416868 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:29.419900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.420558 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d656ba-47, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.422135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.423583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.430680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.431231 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.432212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba6c2eff-a4, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.433921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.434695 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.435061 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.436571 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.436872 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a945dd0-3481-468d-9396-817fba088adb) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.437400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.437924 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.439368 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.440271 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.440715 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=730525ff-b2c0-43c4-bbd9-a35dd398e1fb) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.441822 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.442875 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.443188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.445078 np0000000747 nova-compute[97971]: INFO os_vif [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:8c,bridge_name='br-int',has_traffic_filtering=True,id=08d656ba-4789-4687-9c3a-eaaf2593b3dd,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656ba-47')
May 14 04:28:29.445443 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Deleting instance files /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2_del
May 14 04:28:29.446639 np0000000747 nova-compute[97971]: INFO os_vif [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:e4,bridge_name='br-int',has_traffic_filtering=True,id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c,network=Network(fa2c30e4-28c7-4629-b2ca-c236dd1de745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6c2eff-a4')
May 14 04:28:29.447315 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Deleting instance files /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493_del
May 14 04:28:29.447315 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Deletion of /opt/stack/data/nova/instances/34b571d5-617e-4f48-8368-7bb5fc36bfa2_del complete
May 14 04:28:29.453885 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Deletion of /opt/stack/data/nova/instances/29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493_del complete
May 14 04:28:29.477249 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.505057 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.520147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.525633 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732909.5252132, c249f70f-670b-4f62-adad-6093dc284b23 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:28:29.530286 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Start waiting for the detach event from libvirt for device tap4b63c1ee-11 with device alias net1 for instance c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:28:29.530286 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:29.535249 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface>not found in domain: <domain type='qemu' id='20'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <name>instance-00000010</name>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <uuid>c249f70f-670b-4f62-adad-6093dc284b23</uuid>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:06</nova:creationTime>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <nova:port uuid="4b63c1ee-11b8-42bd-8dff-fa978bc85a65">
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <memory unit='KiB'>196608</memory>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <vcpu placement='static'>1</vcpu>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <resource>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <partition>/machine</partition>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </resource>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <sysinfo type='smbios'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='product'>OpenStack Nova</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='version'>33.1.0</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='serial'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='uuid'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <entry name='family'>Virtual Machine</entry>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <boot dev='hd'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <smbios mode='sysinfo'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <vmcoreinfo state='on'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <cpu mode='custom' match='exact' check='full'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <model fallback='forbid'>Nehalem</model>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <feature policy='require' name='hypervisor'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <clock offset='utc'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <on_poweroff>destroy</on_poweroff>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <on_reboot>restart</on_reboot>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <on_crash>destroy</on_crash>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <disk type='file' device='disk'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk' index='2'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <backingStore type='file' index='3'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:         <format type='raw'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:         <source file='/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:         <backingStore/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       </backingStore>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <target dev='vda' bus='virtio'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='virtio-disk0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <disk type='file' device='cdrom'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <driver name='qemu' type='raw' cache='none'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config' index='1'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <backingStore/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <target dev='hda' bus='ide'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <readonly/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='ide0-0-0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <controller type='usb' index='0' model='none'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='usb'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <controller type='pci' index='0' model='pci-root'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='pci.0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <controller type='ide' index='0'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='ide'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <interface type='ethernet'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <mac address='fa:16:3e:a5:f7:19'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <target dev='tap7928820e-0a'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <model type='virtio'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <driver name='qemu'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <mtu size='1372'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='net0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <serial type='pty'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <target type='isa-serial' port='0'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:         <model name='isa-serial'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       </target>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <console type='pty' tty='/dev/pts/7'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <target type='serial' port='0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </console>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <input type='mouse' bus='ps2'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='input0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <input type='keyboard' bus='ps2'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='input1'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <listen type='address' address='0.0.0.0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <audio id='1' type='none'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <model type='virtio' heads='1' primary='yes'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='video0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <stats period='10'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='balloon0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <rng model='virtio'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <backend model='random'>/dev/urandom</backend>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <alias name='rng0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <label>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</label>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <imagelabel>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</imagelabel>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <label>+64055:+993</label>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:     <imagelabel>+64055:+993</imagelabel>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:29.535249 np0000000747 nova-compute[97971]:  {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 04:28:29.540333 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully detached device tap4b63c1ee-11 from instance c249f70f-670b-4f62-adad-6093dc284b23 from the live domain config.
May 14 04:28:29.540333 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:29.540333 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:29.540333 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:29.540333 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:29.540911 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.545853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.545853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b63c1ee-11, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.545853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.546589 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.563450 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.568837 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.568837 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a724c81-9fe4-4eac-ad2e-1fb7be151f14) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:29.568837 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.569975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:29.573154 np0000000747 nova-compute[97971]: INFO os_vif [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11')
May 14 04:28:29.574256 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1159631461', uuid='c249f70f-670b-4f62-adad-6093dc284b23'), owner=OwnerMeta(userid='7778c84ee3f3406999f838e5009483a3', username='tempest-TaggedAttachmentsTest-1756793520-project-member', projectid='781e2f73cfe2496391efde04eee02a9e', projectname='tempest-TaggedAttachmentsTest-1756793520'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732909.573881) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:29.574902 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:29</nova:creationTime>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:29.574902 np0000000747 nova-compute[97971]:  {{(pid=97971) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 04:28:29.579380 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:29.579888 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:29.602990 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.622218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:29.841716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found WWN 330000000a6571e3c for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:28:29.842040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:29.842202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000a6571e3c', 'path': '/dev/dm-0', 'multipath_id': '330000000a6571e3c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:29.842320 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a6571e3c', 'path': '/dev/dm-0', 'multipath_id': '330000000a6571e3c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:28:29.854477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.158s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:29.855003 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:28:29.857566 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.226s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:29.865476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:29.865596 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Claim successful on node np0000000747
May 14 04:28:29.902142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:29.966632 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Took 1.51 seconds to destroy the instance on the hypervisor.
May 14 04:28:29.967547 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Took 1.63 seconds to destroy the instance on the hypervisor.
May 14 04:28:29.968215 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:28:29.968653 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:28:29.970490 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:28:29.971292 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:28:29.971292 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:28:29.971410 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:29.972472 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:29.975074 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:28:30.082494 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:30.146325 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:30.348966 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:30.349567 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:30.350025 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:30.351976 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'pci_devices' on Instance uuid ec7eb127-aa14-4632-aadd-d50696b45625 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:30.363147 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:28:30.363352 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:28:30.363707 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:30.366171 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:30.577124 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:28:30.677704 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2ad023e7-a757-4666-aafe-798184c36e32 req-328d7efb-9310-46fa-a5b9-36e27cdcb986 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-deleted-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:30.677873 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-2ad023e7-a757-4666-aafe-798184c36e32 req-328d7efb-9310-46fa-a5b9-36e27cdcb986 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Neutron deleted interface ba6c2eff-a446-4a05-b7e7-8c029f9d431c; detaching it from the instance and deleting it from the info cache
May 14 04:28:30.678141 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2ad023e7-a757-4666-aafe-798184c36e32 req-328d7efb-9310-46fa-a5b9-36e27cdcb986 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:30.826601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.856339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <uuid>ec7eb127-aa14-4632-aadd-d50696b45625</uuid>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <name>instance-00000015</name>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherA-server-1210740464</nova:name>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:26</nova:creationTime>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:user uuid="5a8ede1ead104b17957a4b8b20b80d6b">tempest-ServerActionsTestOtherA-1166153365-project-member</nova:user>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:project uuid="c6680b6e8f4e4852b7d9bb1f67e84fe6">tempest-ServerActionsTestOtherA-1166153365</nova:project>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         <nova:port uuid="d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="serial">ec7eb127-aa14-4632-aadd-d50696b45625</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="uuid">ec7eb127-aa14-4632-aadd-d50696b45625</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <alias name="ua-90ebb94c-0b74-48de-ba06-6488816ef98b"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <serial>90ebb94c-0b74-48de-ba06-6488816ef98b</serial>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:7a:ea:bc"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <target dev="tapd7a5f1d8-89"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/console.log" append="off"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:30.856339 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:30.856339 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Preparing to wait for external event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:28:30.856339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:30.856339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e790e26f-890d-5b6e-8ed0-ba38d9371806', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:30.863570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.867400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:30.868166 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:28:30.872863 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.873122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7a5f1d8-89, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:30.873799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7a5f1d8-89, col_values=(('qos', UUID('076ffd90-8537-4155-9300-b3e62383f3ab')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:30.874033 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7a5f1d8-89, col_values=(('external_ids', {'iface-id': 'd7a5f1d8-8944-4089-b5fd-7eb0f92fde1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ea:bc', 'vm-uuid': 'ec7eb127-aa14-4632-aadd-d50696b45625'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:30.880042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.883305 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:30.886416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:30.890840 np0000000747 nova-compute[97971]: INFO os_vif [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89')
May 14 04:28:30.957255 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:30.957441 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] Acquiring lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:30.957629 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:30.957833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:30.958005 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] No waiting events found dispatching network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:30.958061 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Received event network-vif-unplugged-ba6c2eff-a446-4a05-b7e7-8c029f9d431c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:30.958216 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-deleted-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:30.958306 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Neutron deleted interface 08d656ba-4789-4687-9c3a-eaaf2593b3dd; detaching it from the instance and deleting it from the info cache
May 14 04:28:30.958379 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:31.017219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.017416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.017606 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.017741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.017946 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received unexpected event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with vm_state active and task_state deleting.
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received unexpected event network-vif-plugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with vm_state active and task_state deleting.
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:31.021640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] No waiting events found dispatching network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Received event network-vif-unplugged-08d656ba-4789-4687-9c3a-eaaf2593b3dd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:31.022827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:31.023064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:31.023064 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:31.023144 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received unexpected event network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 for instance with vm_state active and task_state None.
May 14 04:28:31.023556 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-deleted-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:31.023556 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Neutron deleted interface 4b63c1ee-11b8-42bd-8dff-fa978bc85a65; detaching it from the instance and deleting it from the info cache
May 14 04:28:31.023836 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:31.035384 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:31.102860 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:31.156493 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Successfully created port: 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:28:31.185201 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2ad023e7-a757-4666-aafe-798184c36e32 req-328d7efb-9310-46fa-a5b9-36e27cdcb986 service nova] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Detach interface failed, port_id=ba6c2eff-a446-4a05-b7e7-8c029f9d431c, reason: Instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:31.374221 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:28:31.467244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6de5a79a-3af3-4085-a23b-847a687cbc99 req-b3cb53cb-646b-4886-a640-466cb575c180 service nova] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Detach interface failed, port_id=08d656ba-4789-4687-9c3a-eaaf2593b3dd, reason: Instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:31.530021 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lazy-loading 'system_metadata' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:31.543975 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Took 1.57 seconds to deallocate network for instance.
May 14 04:28:31.605131 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Took 1.63 seconds to deallocate network for instance.
May 14 04:28:31.761603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:31.761794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquired lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:31.761984 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:31.771537 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Successfully updated port: 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:31.824376 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:31.824691 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:32.033897 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lazy-loading 'flavor' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:32.054431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.114846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.265120 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:32.276407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:32.276407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:32.276550 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:32.329486 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:32.390588 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:28:32.392476 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:28:32.392893 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Creating image(s)
May 14 04:28:32.393436 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.394119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:32.394462 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:32.395115 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:32.400432 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:32.402855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:32.430315 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:32.430945 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:32.430945 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:7a:ea:bc, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:32.431515 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Using config drive
May 14 04:28:32.519025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:32.519025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.519708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:32.521218 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:32.527149 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:32.528188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:32.549176 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Object Instance<c249f70f-670b-4f62-adad-6093dc284b23> lazy-loaded attributes: system_metadata,flavor {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:28:32.569753 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:32.569753 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:32.569753 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:32.578303 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:32.583256 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface>not found in domain: <domain type='qemu' id='20'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <name>instance-00000010</name>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <uuid>c249f70f-670b-4f62-adad-6093dc284b23</uuid>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:29</nova:creationTime>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <memory unit='KiB'>196608</memory>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <vcpu placement='static'>1</vcpu>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <resource>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <partition>/machine</partition>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </resource>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <sysinfo type='smbios'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='product'>OpenStack Nova</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='version'>33.1.0</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='serial'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='uuid'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <entry name='family'>Virtual Machine</entry>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <boot dev='hd'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <smbios mode='sysinfo'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <vmcoreinfo state='on'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <cpu mode='custom' match='exact' check='full'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <model fallback='forbid'>Nehalem</model>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <feature policy='require' name='hypervisor'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <clock offset='utc'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <on_poweroff>destroy</on_poweroff>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <on_reboot>restart</on_reboot>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <on_crash>destroy</on_crash>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <disk type='file' device='disk'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk' index='2'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <backingStore type='file' index='3'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:         <format type='raw'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:         <source file='/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:         <backingStore/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       </backingStore>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <target dev='vda' bus='virtio'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='virtio-disk0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <disk type='file' device='cdrom'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <driver name='qemu' type='raw' cache='none'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config' index='1'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <backingStore/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <target dev='hda' bus='ide'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <readonly/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='ide0-0-0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <controller type='usb' index='0' model='none'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='usb'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <controller type='pci' index='0' model='pci-root'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='pci.0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <controller type='ide' index='0'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='ide'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <interface type='ethernet'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <mac address='fa:16:3e:a5:f7:19'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <target dev='tap7928820e-0a'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <model type='virtio'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <driver name='qemu'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <mtu size='1372'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='net0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <serial type='pty'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <target type='isa-serial' port='0'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:         <model name='isa-serial'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       </target>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <console type='pty' tty='/dev/pts/7'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <target type='serial' port='0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </console>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <input type='mouse' bus='ps2'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='input0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <input type='keyboard' bus='ps2'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='input1'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <listen type='address' address='0.0.0.0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <audio id='1' type='none'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <model type='virtio' heads='1' primary='yes'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='video0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <stats period='10'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='balloon0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <rng model='virtio'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <backend model='random'>/dev/urandom</backend>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <alias name='rng0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <label>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</label>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <imagelabel>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</imagelabel>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <label>+64055:+993</label>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:     <imagelabel>+64055:+993</imagelabel>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:32.583256 np0000000747 nova-compute[97971]:  {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 04:28:32.586023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface> {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 14 04:28:32.586325 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a1:01"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4b63c1ee-11"/></interface>not found in domain: <domain type='qemu' id='20'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <name>instance-00000010</name>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <uuid>c249f70f-670b-4f62-adad-6093dc284b23</uuid>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:29</nova:creationTime>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <memory unit='KiB'>196608</memory>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <currentMemory unit='KiB'>196608</currentMemory>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <vcpu placement='static'>1</vcpu>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <resource>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <partition>/machine</partition>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </resource>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <sysinfo type='smbios'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='product'>OpenStack Nova</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='version'>33.1.0</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='serial'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='uuid'>c249f70f-670b-4f62-adad-6093dc284b23</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <entry name='family'>Virtual Machine</entry>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <boot dev='hd'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <smbios mode='sysinfo'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <vmcoreinfo state='on'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <tb-cache unit='KiB'>131072</tb-cache>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <cpu mode='custom' match='exact' check='full'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <model fallback='forbid'>Nehalem</model>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <feature policy='require' name='hypervisor'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <clock offset='utc'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <on_poweroff>destroy</on_poweroff>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <on_reboot>restart</on_reboot>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <on_crash>destroy</on_crash>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <disk type='file' device='disk'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <driver name='qemu' type='qcow2' cache='none'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk' index='2'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <backingStore type='file' index='3'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:         <format type='raw'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:         <source file='/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:         <backingStore/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       </backingStore>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <target dev='vda' bus='virtio'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='virtio-disk0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <disk type='file' device='cdrom'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <driver name='qemu' type='raw' cache='none'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <source file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/disk.config' index='1'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <backingStore/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <target dev='hda' bus='ide'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <readonly/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='ide0-0-0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <controller type='usb' index='0' model='none'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='usb'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <controller type='pci' index='0' model='pci-root'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='pci.0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <controller type='ide' index='0'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='ide'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </controller>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <interface type='ethernet'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <mac address='fa:16:3e:a5:f7:19'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <target dev='tap7928820e-0a'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <model type='virtio'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <driver name='qemu'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <mtu size='1372'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='net0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <serial type='pty'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <target type='isa-serial' port='0'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:         <model name='isa-serial'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       </target>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <console type='pty' tty='/dev/pts/7'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <source path='/dev/pts/7'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <log file='/opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23/console.log' append='off'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <target type='serial' port='0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='serial0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </console>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <input type='mouse' bus='ps2'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='input0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <input type='keyboard' bus='ps2'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='input1'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </input>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <listen type='address' address='0.0.0.0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </graphics>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <audio id='1' type='none'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <model type='virtio' heads='1' primary='yes'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='video0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <stats period='10'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='balloon0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <rng model='virtio'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <backend model='random'>/dev/urandom</backend>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <alias name='rng0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <label>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</label>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <imagelabel>libvirt-c249f70f-670b-4f62-adad-6093dc284b23</imagelabel>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <label>+64055:+993</label>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:     <imagelabel>+64055:+993</imagelabel>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:   </seclabel>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:32.586325 np0000000747 nova-compute[97971]:  {{(pid=97971) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 14 04:28:32.588945 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Detaching interface fa:16:3e:f5:a1:01 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4b63c1ee-11' not found.
May 14 04:28:32.588945 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000747',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:32.588945 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Converting VIF {"id": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "address": "fa:16:3e:f5:a1:01", "network": {"id": "d64631a9-48a5-4df6-9d0f-e0a6e7a39c25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1522975766", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b63c1ee-11", "ovs_interfaceid": "4b63c1ee-11b8-42bd-8dff-fa978bc85a65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:32.588945 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:32.588945 np0000000747 nova-compute[97971]: DEBUG os_vif [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:32.589529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:32.590186 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b63c1ee-11, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:32.590422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:32.595839 np0000000747 nova-compute[97971]: INFO os_vif [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a1:01,bridge_name='br-int',has_traffic_filtering=True,id=4b63c1ee-11b8-42bd-8dff-fa978bc85a65,network=Network(d64631a9-48a5-4df6-9d0f-e0a6e7a39c25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b63c1ee-11')
May 14 04:28:32.597017 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1159631461', uuid='c249f70f-670b-4f62-adad-6093dc284b23'), owner=OwnerMeta(userid='7778c84ee3f3406999f838e5009483a3', username='tempest-TaggedAttachmentsTest-1756793520-project-member', projectid='781e2f73cfe2496391efde04eee02a9e', projectname='tempest-TaggedAttachmentsTest-1756793520'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732912.596564) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:32.597425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:package version="33.1.0"/>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:name>tempest-device-tagging-server-1159631461</nova:name>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:creationTime>2026-05-14 04:28:32</nova:creationTime>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:flavor name="m1.nano" id="42">
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:memory>192</nova:memory>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:disk>1</nova:disk>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:swap>0</nova:swap>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:vcpus>1</nova:vcpus>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:extraSpecs>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     </nova:extraSpecs>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   </nova:flavor>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:minDisk>1</nova:minDisk>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:minRam>0</nova:minRam>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:properties>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     </nova:properties>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   </nova:image>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:owner>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:user uuid="7778c84ee3f3406999f838e5009483a3">tempest-TaggedAttachmentsTest-1756793520-project-member</nova:user>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:project uuid="781e2f73cfe2496391efde04eee02a9e">tempest-TaggedAttachmentsTest-1756793520</nova:project>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   </nova:owner>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   <nova:ports>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     <nova:port uuid="7928820e-0ad1-4a1b-900d-f0be8b0b4298">
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:     </nova:port>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:   </nova:ports>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]: </nova:instance>
May 14 04:28:32.597425 np0000000747 nova-compute[97971]:  {{(pid=97971) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 14 04:28:32.599737 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:32.600284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.600584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:32.600841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:32.601007 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:32.601187 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9ddc5244-f244-426e-9f7f-afb05b461265 req-ad030447-b8e9-4950-b291-0d892f407d52 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received unexpected event network-vif-unplugged-4b63c1ee-11b8-42bd-8dff-fa978bc85a65 for instance with vm_state active and task_state None.
May 14 04:28:32.641089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:32.641089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:32.690881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk 1073741824" returned: 0 in 0.050s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:32.691370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:32.691855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:32.754308 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:32.765681 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004467389999263105 future=<Future at 0x7435f84c6ab0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:32.765833 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:32.766079 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.1583779320001213 future=<Future at 0x7435f84094f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:32.766226 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.1582368010001574 future=<Future at 0x7435f84094f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:32.791555 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:32.791924 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:28:32.792124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:32.842006 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.984s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:32.842006 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:28:32.848640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.947s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:32.900642 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:32.905518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:32.905518 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:28:32.905518 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:28:32.905518 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Ensure instance console log exists: /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:28:32.906025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:32.906234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:32.906416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:32.950371 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:32.980897 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [{"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:33.097641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:33.098508 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing instance network info cache due to event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:33.098802 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:33.119170 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Creating config drive at /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config
May 14 04:28:33.123033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2cqk54mb {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:33.171846 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:33.191021 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2cqk54mb" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:33.364785 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:28:33.366801 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:28:33.373239 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:33.374262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:33.374732 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:33.378840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:33.383042 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:33.477337 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79086847c5a343519481b0a50930103f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaef82fed39403a80c7ec4baa8ad091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:28:33.483301 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Releasing lock "refresh_cache-c249f70f-670b-4f62-adad-6093dc284b23" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:33.718738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:33.754119 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:33.838177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:33.863763 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:28:33.887444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:33.887444 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance network_info: |[{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:28:33.887444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:33.887444 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:33.896002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start _get_guest_xml network_info=[{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:33.901550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:28:33.908916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:33.913567 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:33.917073 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='85a9913c-942d-4796-86b3-dc12a56ee6fd'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732913.915094) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:33.918488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:33.918959 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:33.921537 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:33.921936 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:33.926055 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:33.928635 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:33.928635 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:33.928635 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:33.928635 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:33.929243 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:33.929578 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:33.931340 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:33.935191 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:33.935902 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:33.935902 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:33.935902 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:33.936254 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:33.936254 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:33.954391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:33.954640 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:33.955411 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:33.958902 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:33.988580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e91d05d-7a73-4990-aa53-80fbeb932d60 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "interface-c249f70f-670b-4f62-adad-6093dc284b23-4b63c1ee-11b8-42bd-8dff-fa978bc85a65" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.747s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:34.344953 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Successfully created port: e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:28:34.367670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:28:34.397921 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:34.443516 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:34.462044 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <uuid>85a9913c-942d-4796-86b3-dc12a56ee6fd</uuid>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <name>instance-00000016</name>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-1</nova:name>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:33</nova:creationTime>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         <nova:port uuid="6b5be577-bb55-41a2-ae2e-178c3bd132cc">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="serial">85a9913c-942d-4796-86b3-dc12a56ee6fd</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="uuid">85a9913c-942d-4796-86b3-dc12a56ee6fd</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:f4:99:43"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <target dev="tap6b5be577-bb"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/console.log" append="off"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:34.462044 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:34.464599 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Preparing to wait for external event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:28:34.464599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:34.464599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:34.464599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:34.466144 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:34.467407 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:34.470017 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:34.470352 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:34.472350 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.472623 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:34.472910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:34.476157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.476318 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e77f07b-aff5-56de-ab4c-99dd0cca9d98', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:34.479405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.480495 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:34.481458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.485958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.486178 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b5be577-bb, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:34.486562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b5be577-bb, col_values=(('qos', UUID('9301b554-ead0-410c-a050-830681c00660')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:34.486797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b5be577-bb, col_values=(('external_ids', {'iface-id': '6b5be577-bb55-41a2-ae2e-178c3bd132cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:99:43', 'vm-uuid': '85a9913c-942d-4796-86b3-dc12a56ee6fd'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:34.488799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.491047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:34.497135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:34.497905 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:34.498992 np0000000747 nova-compute[97971]: INFO os_vif [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb')
May 14 04:28:34.627196 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732914.6268222, ec7eb127-aa14-4632-aadd-d50696b45625 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:34.627771 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Started (Lifecycle Event)
May 14 04:28:34.854964 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:34.924903 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00044605699986277614 future=<Future at 0x7435f84094f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:34.925729 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:34.925729 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.93321129800006 future=<Future at 0x7435f8456b10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:34.925729 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.933116584000118 future=<Future at 0x7435f8456b10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:34.925871 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Emitting event <LifecycleEvent: 1778732899.9243033, 4da473ba-6f29-4334-b061-1d1d34f65717 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:34.926035 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] VM Stopped (Lifecycle Event)
May 14 04:28:34.953631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.105s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:34.957986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.900s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.044131 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Deleted allocations for instance 4da473ba-6f29-4334-b061-1d1d34f65717
May 14 04:28:35.081583 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updated VIF entry in instance network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:35.081980 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:35.110054 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Successfully updated port: e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:35.130443 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:35.137058 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732915.136716, ec7eb127-aa14-4632-aadd-d50696b45625 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:35.137237 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Paused (Lifecycle Event)
May 14 04:28:35.174045 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:35.174300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing instance network info cache due to event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:35.177018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:35.177519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:35.177519 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:35.188850 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:35.189248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.190137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.190381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:35.190605 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Processing event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:28:35.191019 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:35.191226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.191412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.191572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:35.191766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:35.192066 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-97ca3c5d-ed09-49be-b6f1-1d1eef9e0880 req-1510d97c-30af-4805-bbd0-874c027a883c service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received unexpected event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with vm_state building and task_state spawning.
May 14 04:28:35.192947 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:28:35.197639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:28:35.203053 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance spawned successfully.
May 14 04:28:35.203634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:28:35.204571 np0000000747 nova-compute[97971]: WARNING oslo_messaging._drivers.amqpdriver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
May 14 04:28:35.424528 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:28:35.444241 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 4da473ba-6f29-4334-b061-1d1d34f65717] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:35.445792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:28:35.450460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.450828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.451724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.452053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.452440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:35.455050 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Creating image(s)
May 14 04:28:35.459924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.461184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.461811 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Terminating instance
May 14 04:28:35.463592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:35.464254 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:35.472684 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:35.474709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:35.581900 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:28:35.583182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:35.583908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:35.584717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:35.585642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4571db7b-ea1c-499f-8ea4-a57eaf845bed req-2906ffcd-abf2-4f2e-83ce-49f64cd0cd68 service nova] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:35.586662 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:35.591817 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:35.592681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:35.616588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:35.640308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:35.649481 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732915.6490855, ec7eb127-aa14-4632-aadd-d50696b45625 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:35.649831 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Resumed (Lifecycle Event)
May 14 04:28:35.680331 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:35.704245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:35.704859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:35.746710 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.746868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.747434 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.747674 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.748023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.748340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:35.769957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk 1073741824" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:35.770625 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:35.771354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:35.828362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:35.844295 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:35.860265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:35.860859 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:28:35.861194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:35.970610 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:28:36.004114 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:36.006480 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Cannot resize image /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:28:36.007773 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:28:36.007773 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Ensure instance console log exists: /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:28:36.009145 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:36.009670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:36.009670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:36.013005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.019019 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.050193 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.060120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db1d7381-a9cb-4c7a-8481-63de9a463262 tempest-TaggedBootDevicesTest-986832132 tempest-TaggedBootDevicesTest-986832132-project-member] Lock "4da473ba-6f29-4334-b061-1d1d34f65717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.362s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:36.064208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:36.064208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:36.064208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:f4:99:43, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:36.066919 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Using config drive
May 14 04:28:36.075319 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.115088 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.119787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.153328 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:36.171966 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:36.251506 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:36.256050 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Took 9.50 seconds to spawn the instance on the hypervisor.
May 14 04:28:36.260685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:36.279440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:36.279440 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:36.382941 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Instance destroyed successfully.
May 14 04:28:36.384720 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lazy-loading 'resources' on Instance uuid c249f70f-670b-4f62-adad-6093dc284b23 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:36.577259 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:36.679253 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:28:36.679725 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999807823999845 future=<Future at 0x7435f8391eb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:36.736917 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Creating config drive at /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config
May 14 04:28:36.741876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7wwj254 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:36.758516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d46716fa-5ab6-4145-9aeb-1d3478e73e42 req-81b2b110-d2b7-4eed-9b2f-600985fca56a service nova] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:36.759286 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:36.759793 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:36.786170 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:36.792204 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Took 17.89 seconds to build instance.
May 14 04:28:36.794477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7wwj254" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:36.886776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1159631461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-1159631461',id=16,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOTGtZiy0/MipXrj24zZXhO90kZofWlEfLcdLHl6Bq8zNQENM9/1asryCqh7YXeXMlHKIL4vQKHWdEHxdZaXMp9PiBv1u4yQrt2W8lRvbNLdyZbpTdB4cOOG3Ftc9R+kA==',key_name='tempest-keypair-179025683',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781e2f73cfe2496391efde04eee02a9e',ramdisk_id='',reservation_id='r-1uu7mzu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1756793520',owner_user_name='tempest-TaggedAttachmentsTest-1756793520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7778c84ee3f3406999f838e5009483a3',uuid=c249f70f-670b-4f62-adad-6093dc284b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:36.887041 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converting VIF {"id": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "address": "fa:16:3e:a5:f7:19", "network": {"id": "b999e41c-a07a-48a5-b217-029552b75be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-458844119-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "781e2f73cfe2496391efde04eee02a9e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7928820e-0a", "ovs_interfaceid": "7928820e-0ad1-4a1b-900d-f0be8b0b4298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:36.887723 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:36.887941 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:36.890393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.890892 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7928820e-0a, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:36.892539 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.893515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:36.903428 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.904576 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.904810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=956802f6-8f17-4f54-b154-7cd7e4631ec8) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:36.905894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.906083 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:36.911270 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:36.913540 np0000000747 nova-compute[97971]: INFO os_vif [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f7:19,bridge_name='br-int',has_traffic_filtering=True,id=7928820e-0ad1-4a1b-900d-f0be8b0b4298,network=Network(b999e41c-a07a-48a5-b217-029552b75be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7928820e-0a')
May 14 04:28:36.913957 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Deleting instance files /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23_del
May 14 04:28:36.914737 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Deletion of /opt/stack/data/nova/instances/c249f70f-670b-4f62-adad-6093dc284b23_del complete
May 14 04:28:37.232837 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:37.264487 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:37.270992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:37.279701 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:37.280038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:37.280328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:37.280527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:37.284107 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:37.284686 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:37.284897 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:37.287973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Acquiring lock "c249f70f-670b-4f62-adad-6093dc284b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:37.287973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:37.287973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] Lock "c249f70f-670b-4f62-adad-6093dc284b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:37.287973 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] No waiting events found dispatching network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:37.287973 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e999d1a-30b1-44da-b43b-b1f656366843 req-c2080e3f-f996-4295-a6c9-e6619abb8f85 service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-unplugged-7928820e-0ad1-4a1b-900d-f0be8b0b4298 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:28:37.296779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.343s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:37.300093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-112fd386-0415-4770-947f-e2aaec6365a3 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.418s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:37.301438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.186s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:37.395830 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:37.418111 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Deleted allocations for instance 34b571d5-617e-4f48-8368-7bb5fc36bfa2
May 14 04:28:37.430172 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Took 1.46 seconds to destroy the instance on the hypervisor.
May 14 04:28:37.430939 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:28:37.431315 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:28:37.431315 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:28:37.431424 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:37.435878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:37.457047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:37.780749 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:37.784645 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:38.169112 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:38.438129 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d09b418d-3ab0-4989-af88-10b85fa85ee9 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "34b571d5-617e-4f48-8368-7bb5fc36bfa2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.501s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:38.450147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:38.450147 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:38.502436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5d8f9876-9e6c-4c05-a7d1-ce0edae7e81d req-97ff44c3-376a-4ec1-99b2-e8dd1fd1dccd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Received event network-vif-deleted-7928820e-0ad1-4a1b-900d-f0be8b0b4298 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:38.502689 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-5d8f9876-9e6c-4c05-a7d1-ce0edae7e81d req-97ff44c3-376a-4ec1-99b2-e8dd1fd1dccd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Neutron deleted interface 7928820e-0ad1-4a1b-900d-f0be8b0b4298; detaching it from the instance and deleting it from the info cache
May 14 04:28:38.504254 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5d8f9876-9e6c-4c05-a7d1-ce0edae7e81d req-97ff44c3-376a-4ec1-99b2-e8dd1fd1dccd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:38.512019 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732918.5111952, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:38.512234 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Started (Lifecycle Event)
May 14 04:28:38.674448 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:38.674909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance network_info: |[{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:28:38.681708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start _get_guest_xml network_info=[{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:38.685126 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:38.687844 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1739446664', uuid='a7b6e4bf-576f-438e-907f-71fef72b19b5'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732918.6867454) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:38.691328 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:38.691938 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:38.696014 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:38.696291 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:38.697393 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:38.697765 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:38.697972 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:38.698162 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:38.698715 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:38.698715 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:38.698715 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:38.701920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:38.701920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:38.701920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:38.701920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:38.701920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:38.718281 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1739446664',display_name='tempest-ServerRescueNegativeTestJSON-server-1739446664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1739446664',id=23,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYqv3s463mDZiZNCMV6O57fhNxf2RO2CpxEBkvzL2dkobV1k8FqQgv/RWk0eox7we2ogr+KSmSOxKTRWXSY5Gq3EDTpU7HagD6Mla6dAXMddfk7ZilmxO0oQoGK7Yo5w==',key_name='tempest-keypair-1249813357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-0uhmj886',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79086847c5a343519481b0a50930103f',uuid=a7b6e4bf-576f-438e-907f-71fef72b19b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:38.718526 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:38.719113 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:38.719744 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:38.909586 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:38.953571 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:39.013573 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5d8f9876-9e6c-4c05-a7d1-ce0edae7e81d req-97ff44c3-376a-4ec1-99b2-e8dd1fd1dccd service nova] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Detach interface failed, port_id=7928820e-0ad1-4a1b-900d-f0be8b0b4298, reason: Instance c249f70f-670b-4f62-adad-6093dc284b23 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:28:39.016333 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:39.019341 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732919.0189385, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:39.019990 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Paused (Lifecycle Event)
May 14 04:28:39.202817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:39.202965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing instance network info cache due to event network-changed-cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:39.203676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] Acquiring lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:39.203676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] Acquired lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:39.203676 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Refreshing network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:39.223068 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <uuid>a7b6e4bf-576f-438e-907f-71fef72b19b5</uuid>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <name>instance-00000017</name>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1739446664</nova:name>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:38</nova:creationTime>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         <nova:port uuid="e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="serial">a7b6e4bf-576f-438e-907f-71fef72b19b5</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="uuid">a7b6e4bf-576f-438e-907f-71fef72b19b5</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:b8:5b"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <target dev="tape3bbd018-f0"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/console.log" append="off"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:39.223068 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Preparing to wait for external event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1739446664',display_name='tempest-ServerRescueNegativeTestJSON-server-1739446664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1739446664',id=23,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYqv3s463mDZiZNCMV6O57fhNxf2RO2CpxEBkvzL2dkobV1k8FqQgv/RWk0eox7we2ogr+KSmSOxKTRWXSY5Gq3EDTpU7HagD6Mla6dAXMddfk7ZilmxO0oQoGK7Yo5w==',key_name='tempest-keypair-1249813357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-0uhmj886',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79086847c5a343519481b0a50930103f',uuid=a7b6e4bf-576f-438e-907f-71fef72b19b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:39.225987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.226511 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:39.228671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:39.228671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.228932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13c6e2dd-e743-519a-8c54-4359eda82dc5', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:39.238658 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.240457 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:39.319598 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.324396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.324396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3bbd018-f0, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:39.324396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3bbd018-f0, col_values=(('qos', UUID('fb139b47-138f-4bb4-9207-f3cdb6c3839d')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:39.324396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3bbd018-f0, col_values=(('external_ids', {'iface-id': 'e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b8:5b', 'vm-uuid': 'a7b6e4bf-576f-438e-907f-71fef72b19b5'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:39.325222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.332206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:39.332736 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:39.336309 np0000000747 nova-compute[97971]: INFO os_vif [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0')
May 14 04:28:39.385318 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:39.385318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:39.385894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:39.386408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:39.386596 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Processing event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:39.388086 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c5320f88-aa15-4c66-b5ec-6b36e05fd596 req-700eee28-8e85-4dd2-bda8-5d0cb2b22fa2 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received unexpected event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with vm_state building and task_state spawning.
May 14 04:28:39.388572 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:28:39.394184 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:28:39.397499 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance spawned successfully.
May 14 04:28:39.397499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:28:39.410888 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Took 1.98 seconds to deallocate network for instance.
May 14 04:28:39.462168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:39.465315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.966s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:39.471189 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:39.471189 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Claim successful on node np0000000747
May 14 04:28:39.522566 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:39.530094 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732919.5298142, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:39.530268 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Resumed (Lifecycle Event)
May 14 04:28:39.567532 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Deleted allocations for instance 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493
May 14 04:28:39.707386 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:39.912176 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.912731 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.912731 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.912972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.913318 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.913564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:39.919490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:40.033151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:40.036351 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:40.139286 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:40.338577 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updated VIF entry in instance network info cache for port cc91f949-0929-4282-a5c9-6ae4147a7c9e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:40.338734 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updating instance_info_cache with network_info: [{"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:40.422406 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Took 8.03 seconds to spawn the instance on the hypervisor.
May 14 04:28:40.422638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:40.541373 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:28:40.585430 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2ca3f8f2-c27b-4820-8db4-8cb31a1f1ac5 tempest-TestMultiAttachVolumeSwap-1644439510 tempest-TestMultiAttachVolumeSwap-1644439510-project-member] Lock "29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.755s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:40.830499 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:40.840830 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-aa2d37f0-cad6-4ee7-97fd-814db7b7707a req-6a62bf7c-a76c-44ea-a563-3dda8ccbafc2 service nova] Releasing lock "refresh_cache-fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:40.857439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:40.857568 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:40.857763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:9c:b8:5b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:40.858391 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Using config drive
May 14 04:28:40.934539 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Took 14.31 seconds to build instance.
May 14 04:28:41.216995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:41.217219 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:41.267589 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Stashing vm_state: active {{(pid=97971) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 04:28:41.303439 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-changed-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:41.307978 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Refreshing instance network info cache due to event network-changed-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:41.312214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:41.312395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:41.312568 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Refreshing network info cache for port d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:41.365231 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:41.436337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.822s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:41.541043 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Creating config drive at /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config
May 14 04:28:41.547512 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfozvydug {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:41.623643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfozvydug" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:41.721256 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:41.818657 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:41.853477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:42.155659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:42.189005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:42.232067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.770s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:42.232535 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:28:42.238456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.316s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:42.274182 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:42.312373 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:42.331089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:42.332983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:42.543424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b9b4735-bf1a-4d83-a5de-521ceb38ad06 req-b16cb422-24e6-4822-91e8-4decba38ec57 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:42.543882 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b9b4735-bf1a-4d83-a5de-521ceb38ad06 req-b16cb422-24e6-4822-91e8-4decba38ec57 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:42.544111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b9b4735-bf1a-4d83-a5de-521ceb38ad06 req-b16cb422-24e6-4822-91e8-4decba38ec57 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:42.544179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b9b4735-bf1a-4d83-a5de-521ceb38ad06 req-b16cb422-24e6-4822-91e8-4decba38ec57 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:42.544408 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b9b4735-bf1a-4d83-a5de-521ceb38ad06 req-b16cb422-24e6-4822-91e8-4decba38ec57 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Processing event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:28:42.664709 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updated VIF entry in instance network info cache for port d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:42.667555 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:42.747445 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:28:42.747445 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:28:42.751425 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:42.751425 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:42.901523 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb0d4a5b05c94a7697d02ed951f21543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f783f79d26485a8347214b526fd33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:28:43.171297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-14aaf1fc-d4c9-44bd-8514-67c9cb0a462d req-da902d90-a7aa-4870-8806-4b662d2769da service nova] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:43.253237 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:28:43.295797 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732923.2936769, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:43.295797 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Started (Lifecycle Event)
May 14 04:28:43.296258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:28:43.298778 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:43.298969 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:43.300311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:28:43.302772 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance spawned successfully.
May 14 04:28:43.303069 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:28:43.393422 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:43.393422 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing instance network info cache due to event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:43.393422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:43.393422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:43.393422 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:43.553876 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Successfully created port: 3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:28:43.760863 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:28:43.797083 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:43.801954 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:43.808399 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:43.823722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.823949 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.824448 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.825770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.827348 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.829154 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:43.859589 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0011845950000406447 future=<Future at 0x7435f8456b10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.860110 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.860110 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.02617381999993995 future=<Future at 0x7435f85eecf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.860110 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.026020576999826517 future=<Future at 0x7435f85eecf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.861287 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778732908.8582625, 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:43.861287 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] VM Stopped (Lifecycle Event)
May 14 04:28:43.886569 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.000405391000185773 future=<Future at 0x7435f85eecf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.887716 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.888097 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] Emitting event <LifecycleEvent: 1778732908.8860517, 34b571d5-617e-4f48-8368-7bb5fc36bfa2 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:43.888357 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.7911247109998385 future=<Future at 0x7435f8391eb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.889779 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.7909294500000215 future=<Future at 0x7435f8391eb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:43.889779 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] VM Stopped (Lifecycle Event)
May 14 04:28:43.896405 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:44.280444 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Successfully updated port: 3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:28:44.314726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.079s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:44.316685 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.462s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:44.319845 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:28:44.320149 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732924.3198497, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:44.320330 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Paused (Lifecycle Event)
May 14 04:28:44.340825 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Took 8.91 seconds to spawn the instance on the hypervisor.
May 14 04:28:44.349855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:44.353530 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:44.365801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6f101b2-4abf-4613-a2f0-c42f872237b6 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 29b7c9a2-ef76-4904-b0c8-c0e9ae2e4493] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:44.393833 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1c65daa0-8cb6-49b3-a035-12c4a6f21a0e tempest-VolumesAdminNegativeTest-1828598956 tempest-VolumesAdminNegativeTest-1828598956-project-member] [instance: 34b571d5-617e-4f48-8368-7bb5fc36bfa2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:44.426826 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Deleted allocations for instance c249f70f-670b-4f62-adad-6093dc284b23
May 14 04:28:44.648256 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:44.648603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:44.648706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:44.649109 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:44.649109 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:44.649424 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state None.
May 14 04:28:44.649424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-changed-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:44.649424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Refreshing instance network info cache due to event network-changed-3be17b4b-22ed-4612-9b0c-51594e6f1ba6. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:44.649535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Acquiring lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:44.649664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Acquired lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:44.649791 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Refreshing network info cache for port 3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:44.681043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:44.681043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:44.776831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:28:44.780703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:28:44.780703 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Creating image(s)
May 14 04:28:44.781116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:44.781394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:44.785259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:44.785259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:44.785259 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:44.786902 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:44.788315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:44.827883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:28:44.829272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:44.829572 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Claim successful on node np0000000747
May 14 04:28:44.839691 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732924.8393078, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:44.839872 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Resumed (Lifecycle Event)
May 14 04:28:44.879640 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Took 17.33 seconds to build instance.
May 14 04:28:44.898759 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:44.903141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:44.903141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:44.903141 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:44.905538 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:28:44.907111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:45.010523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:45.016876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:45.064083 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:45.096033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk 1073741824" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:45.096202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:45.096525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:45.152976 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:45.193205 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:45.199909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:45.200750 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:28:45.201060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:45.227772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:45.317726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:45.318234 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Cannot resize image /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:28:45.318349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:28:45.318492 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Ensure instance console log exists: /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:28:45.319165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:45.319420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:45.319762 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:45.334917 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:45.338601 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating resource usage from migration 89008991-18a2-4b28-a320-cc429ce1f46a
May 14 04:28:45.344158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:45.347732 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:45.359187 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updated VIF entry in instance network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:45.360003 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:45.384265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.841s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:45.448186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21be4fb6-3d00-4e27-a32a-ea2956a80582 tempest-TaggedAttachmentsTest-1756793520 tempest-TaggedAttachmentsTest-1756793520-project-member] Lock "c249f70f-670b-4f62-adad-6093dc284b23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.997s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:45.834518 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing instance network info cache due to event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:45.863205 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:45.985155 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:46.041677 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:46.076646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:28:46.076946 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:28:46.205518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.526s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:46.368117 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:46.487435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6b4fd1a-66d4-43ef-a2cf-3399a83512b4 req-5aa74afc-e4e2-4935-9475-86bd5986ffc2 service nova] Releasing lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:46.488631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquired lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:46.488997 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:46.579972 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:28:47.009629 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:47.010894 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing instance network info cache due to event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:47.010894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:47.010894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:47.010894 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:47.091964 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.777s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:47.092216 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Migrating
May 14 04:28:47.092481 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:28:47.313345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:47.313648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:47.313924 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attaching volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 to /dev/vdb
May 14 04:28:47.391684 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:47.410861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:28:47.420502 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:28:47.443288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:47.499191 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:28:47.499191 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:28:47.512343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:28:47.514190 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b'] 
May 14 04:28:47.514364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:28:47.514503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:28:47.514910 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:47.515257 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating existing volume attachment record: f534686c-e768-4ca7-a127-2ccd697a8cad {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:28:47.520907 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:47.615052 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:47.615258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:47.615993 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:47.878374 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:48.112778 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:48.113128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:48.113275 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:48.113703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:48.113955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:48.120584 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:48.132167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:48.132928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:48.134336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:48.134674 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:48.135082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:48.135252 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:48.154043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:48.154043 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:48.164865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:28:48.164865 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:48.175940 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53] added
May 14 04:28:48.175940 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:48.175940 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:48.175940 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:48.175940 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:48.175940 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:48.175940 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:48.176322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:48.176857 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:48.176983 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:48.186308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53] added
May 14 04:28:48.186308 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:28:48.186308 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:48.186308 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:48.186308 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:28:48.186308 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:28:48.186308 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:48.186820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:28:48.187023 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0517(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:28:48.187160 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:28:48.237183 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:48.399571 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updated VIF entry in instance network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:48.400109 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:48.641419 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:48.676444 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating instance_info_cache with network_info: [{"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:48.817582 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:48.906771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bd9d0521-1e81-4d11-a27f-77b6eb8c6037 req-440cdc91-2c23-468c-b6ec-3d22569fc2f9 service nova] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:48.930442 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updated VIF entry in instance network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:28:48.931281 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:48.963010 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:49.129000 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.178577 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:49.182556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Releasing lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:49.182794 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance network_info: |[{"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:28:49.185786 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Start _get_guest_xml network_info=[{"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:28:49.187963 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:28:49.189046 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-187578080', uuid='c9c24a0e-4ee9-409f-83cc-e86bcd4152a2'), owner=OwnerMeta(userid='fb0d4a5b05c94a7697d02ed951f21543', username='tempest-VolumesSnapshotTestJSON-9761619-project-member', projectid='59f783f79d26485a8347214b526fd33a', projectname='tempest-VolumesSnapshotTestJSON-9761619'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732929.1885757) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:28:49.191364 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:28:49.191364 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:28:49.192118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:28:49.192347 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:28:49.193703 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:49.194175 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:28:49.195277 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:28:49.195277 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:28:49.195277 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:28:49.195469 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:28:49.195469 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:28:49.195753 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:28:49.195753 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:28:49.196848 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:49.198115 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:49.198115 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.203150 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:28:49.203150 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:28:49.203150 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:28:49.216231 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187578080',display_name='tempest-VolumesSnapshotTestJSON-instance-187578080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-187578080',id=24,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWo4zXsbWUWjk0BvO2FPkLXhg6DRNxDI7tcC0lqlGGflNfsKjpL2X/6/sxW3/Rp/25TNsxbGP8nTsE9KqaY74+oPCuO+1tMp0pqhjxM5z9WK0yXusajidOpHb4rG2c5Hg==',key_name='tempest-keypair-627248677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-uofop6p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=c9c24a0e-4ee9-409f-83cc-e86bcd4152a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:28:49.217933 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:49.221295 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:49.223289 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'pci_devices' on Instance uuid c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:49.226301 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:49.226301 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.231142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.255071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.259886 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.266533 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:49.281499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.281499 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.281499 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.281499 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.281499 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:49.281943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.281943 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.281943 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.281943 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.281943 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:49.322080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.40.100,3260]
May 14 04:28:49.322080 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.40.100,3260] successful.
May 14 04:28:49.322080 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.338845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.350235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.50.100,3260]
May 14 04:28:49.350235 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.50.100,3260] successful.
May 14 04:28:49.350235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.351651 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.363077 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.363364 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:49.363637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:49.363716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:49.365407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '-', '-', 0) found on session 47 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:49.365407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:49.372273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.395657 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:49.398022 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:49.398022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:49.398660 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 47 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:49.402284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:49.406879 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '-', '-', 0) found on session 48 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:49.408436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:49.435597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 48 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:49.435975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cd6ed162-9dd4-4ec8-80b6-e80ba42aae2d req-d66a2e27-9199-4447-a6e0-e772b3978b6f service nova] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:49.729147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] End _get_guest_xml xml=<domain type="qemu">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <uuid>c9c24a0e-4ee9-409f-83cc-e86bcd4152a2</uuid>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <name>instance-00000018</name>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-187578080</nova:name>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:28:49</nova:creationTime>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:user uuid="fb0d4a5b05c94a7697d02ed951f21543">tempest-VolumesSnapshotTestJSON-9761619-project-member</nova:user>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:project uuid="59f783f79d26485a8347214b526fd33a">tempest-VolumesSnapshotTestJSON-9761619</nova:project>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         <nova:port uuid="3be17b4b-22ed-4612-9b0c-51594e6f1ba6">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <system>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="serial">c9c24a0e-4ee9-409f-83cc-e86bcd4152a2</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="uuid">c9c24a0e-4ee9-409f-83cc-e86bcd4152a2</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </system>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <os>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </os>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <features>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </features>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   <devices>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.config"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </disk>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:25:43:ad"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <target dev="tap3be17b4b-22"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </interface>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/console.log" append="off"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </serial>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <video>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </video>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </rng>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:   </devices>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]: </domain>
May 14 04:28:49.729147 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Preparing to wait for external event network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187578080',display_name='tempest-VolumesSnapshotTestJSON-instance-187578080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-187578080',id=24,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWo4zXsbWUWjk0BvO2FPkLXhg6DRNxDI7tcC0lqlGGflNfsKjpL2X/6/sxW3/Rp/25TNsxbGP8nTsE9KqaY74+oPCuO+1tMp0pqhjxM5z9WK0yXusajidOpHb4rG2c5Hg==',key_name='tempest-keypair-627248677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-uofop6p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=c9c24a0e-4ee9-409f-83cc-e86bcd4152a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:49.732115 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:28:49.733257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.733257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:49.736681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:28:49.737901 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.738326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8488e866-e33c-5303-be40-274777b2b968', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:49.739280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.740393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:49.741874 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.745772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.746307 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be17b4b-22, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:49.746992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3be17b4b-22, col_values=(('qos', UUID('1fef2956-9d7a-45e0-a190-3aa03a568e02')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:49.747235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3be17b4b-22, col_values=(('external_ids', {'iface-id': '3be17b4b-22ed-4612-9b0c-51594e6f1ba6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:43:ad', 'vm-uuid': 'c9c24a0e-4ee9-409f-83cc-e86bcd4152a2'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:49.749087 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.752863 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:49.757638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:49.759846 np0000000747 nova-compute[97971]: INFO os_vif [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22')
May 14 04:28:49.765492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:28:50.435820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 48 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:50.435820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:50.835662 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.154247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 3300000000ad49717 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:28:51.154247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:51.154247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:51.154247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:28:51.158202 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:51.292763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Starting migrate_disk_and_power_off {{(pid=97971) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 04:28:51.297003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:51.297003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:51.300565 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No VIF found with MAC fa:16:3e:25:43:ad, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:51.300565 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Using config drive
May 14 04:28:51.350298 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.353751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.382953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.551605 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.561979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.663078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attempting to attach volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:28:51.667564 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999737666000101 future=<Future at 0x7435f8443bc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:51.673570 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance destroyed successfully.
May 14 04:28:51.673570 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:36Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:28:51.673570 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:28:51.678640 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:28:51.678640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]: </disk>
May 14 04:28:51.678640 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:28:51.678640 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:28:51.679217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.679397 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7a5f1d8-89, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:51.680975 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0009256860000732559 future=<Future at 0x7435f8391eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:51.681803 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:51.686788 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Emitting event <LifecycleEvent: 1778732916.6793864, c249f70f-670b-4f62-adad-6093dc284b23 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:51.686967 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] VM Stopped (Lifecycle Event)
May 14 04:28:51.687172 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.977005254999995 future=<Future at 0x7435f8443bc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:51.689129 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:51.705245 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.959013426000183 future=<Future at 0x7435f8443bc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:28:51.705479 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.705869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=076ffd90-8537-4155-9300-b3e62383f3ab) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:28:51.708779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.708779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:28:51.724563 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.739415 np0000000747 nova-compute[97971]: INFO os_vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89')
May 14 04:28:51.750013 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:28:51.750550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:51.751851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:51.752241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:51.752629 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:28:51.752818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:28:51.784123 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:51.784284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:51.784809 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:51.784809 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:51.784809 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:51.786343 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-020e8e05-3ad5-4767-bcaa-4a03df190ce6 req-76819ddf-1298-4987-ae4b-93c21f77ab7d service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received unexpected event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with vm_state active and task_state resize_migrating.
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:51.788102 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:28:51.788102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '46')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:51.788874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '45')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:28:51.790523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184bcc20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:28:51.790523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:28:51.790523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flush multipath device 330000000a6571e3c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:28:51.819725 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:51.848678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:51.933270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:28:51.935435 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:51.986081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:28:51.986081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:28:51.986081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:28:52.009546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:28:52.009826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:28:52.026689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.061015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260]
May 14 04:28:52.061015 np0000000747 nova-compute[97971]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260] successful.
May 14 04:28:52.061015 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.079826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.095872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.131852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260]
May 14 04:28:52.131852 np0000000747 nova-compute[97971]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260] successful.
May 14 04:28:52.131852 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.148201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:52.148201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:52.148201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== disconnect_volume: return (397ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:52.148201 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:28:52.155143 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:28:52.155867 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625_resize/disk.config /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:52.211248 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-73f5cf68-1da5-4dc1-a063-5e01fd618fe7 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: c249f70f-670b-4f62-adad-6093dc284b23] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:52.216047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "cp -r /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625_resize/disk.config /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:52.325184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:52.449766 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Creating config drive at /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.config
May 14 04:28:52.456144 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplocjtkzu {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:52.532111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplocjtkzu" returned: 0 in 0.075s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:28:53.092645 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.130948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.139213 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.246272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.376105 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:53.376295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:53.376505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:28:53.376505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:78:d7:1a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:28:53.443441 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:53.443982 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:53.585602 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.617094 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:53.658560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4ad2360-898d-4f6b-8cfd-f6c968edd615 req-80bcdbf4-757e-471c-ae9e-b89ce67a2aca service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:53.658560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4ad2360-898d-4f6b-8cfd-f6c968edd615 req-80bcdbf4-757e-471c-ae9e-b89ce67a2aca service nova] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:53.658560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4ad2360-898d-4f6b-8cfd-f6c968edd615 req-80bcdbf4-757e-471c-ae9e-b89ce67a2aca service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:53.658560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4ad2360-898d-4f6b-8cfd-f6c968edd615 req-80bcdbf4-757e-471c-ae9e-b89ce67a2aca service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:53.658560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4ad2360-898d-4f6b-8cfd-f6c968edd615 req-80bcdbf4-757e-471c-ae9e-b89ce67a2aca service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Processing event network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:28:53.703945 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Port d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b binding to destination host np0000000747 is already ACTIVE {{(pid=97971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 04:28:53.924686 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:53.924686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:53.924686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:53.924915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:53.924999 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:53.925587 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d2ade481-0a4b-442e-bf7f-8ac566eb328e req-61fe15e5-51dd-4375-b43a-161661002940 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received unexpected event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with vm_state active and task_state resize_migrating.
May 14 04:28:54.308400 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732934.3079505, c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:54.308840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:28:54.308990 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] VM Started (Lifecycle Event)
May 14 04:28:54.312274 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:28:54.316719 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance spawned successfully.
May 14 04:28:54.317059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:28:54.714826 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:28:54.740739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:54.741037 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:54.741224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:54.813024 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:54.816723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:54.839760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.839884 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.841008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.841008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.841008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.841388 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:28:54.851668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:54.852212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:54.961294 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-47f3bdf7-52c8-4de3-8376-a3d5173675d9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.648s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:55.324761 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:28:55.325222 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732935.3247564, c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:55.325222 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] VM Paused (Lifecycle Event)
May 14 04:28:55.350521 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Took 10.57 seconds to spawn the instance on the hypervisor.
May 14 04:28:55.350521 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:55.359498 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:28:55.746734 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:55.786358 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:55.786893 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:55.789112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:55.789181 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:55.789929 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] No waiting events found dispatching network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:28:55.789929 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b09f00d5-3fea-4372-aa0b-f42a00fcf98b req-5bade899-bdd6-4ed6-905c-34ffb0e3d34e service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received unexpected event network-vif-plugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 for instance with vm_state active and task_state None.
May 14 04:28:55.792562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:55.827855 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:55.831931 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732935.8313808, c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:28:55.831931 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] VM Resumed (Lifecycle Event)
May 14 04:28:55.840906 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:55.871311 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Took 21.46 seconds to build instance.
May 14 04:28:55.991009 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:56.208559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:56.208559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:56.208744 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:28:56.337394 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:28:56.342676 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:28:56.372940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.998s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:56.374833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:28:56.707215 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:56.714642 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:57.517640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:28:57.517640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:28:57.517640 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attaching volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 to /dev/vdb
May 14 04:28:57.594826 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:57.613779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:28:57.647069 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:28:57.703647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:28:57.703647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:28:57.714939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:28:57.717053 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7'] 
May 14 04:28:57.717179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:28:57.717290 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:28:57.718101 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:28:57.718101 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating existing volume attachment record: 886cdf9a-d3df-44a2-9022-4d6b6e63b066 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:28:58.292273 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:28:58.293059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:28:58.293268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:58.293954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:58.294166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:28:58.309864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:58.310681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:28:58.311124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:58.311350 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:28:58.312121 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:28:58.312121 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:58.330801 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:58.330801 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:28:58.335520 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:28:58.335520 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:58.346907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:58.358091 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:28:58.368100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.368100 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.368100 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.368100 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.368100 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:58.368538 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.368538 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.368538 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.368538 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.368538 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:58.368835 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:58.368835 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:58.369993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '0', '0', 0) found on session 47 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:58.370127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:58.381869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 47 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:58.381869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:58.389369 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.389369 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.389369 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.389369 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.389369 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:28:58.390634 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.079s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '0', '0', 0) found on session 48 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:28:58.390634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:28:58.420426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 48 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:28:58.420651 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:28:58.439257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:59.280336 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-changed-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:28:59.281238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Refreshing instance network info cache due to event network-changed-3be17b4b-22ed-4612-9b0c-51594e6f1ba6. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:28:59.281643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] Acquiring lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:28:59.282113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] Acquired lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:28:59.282113 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Refreshing network info cache for port 3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:28:59.311331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:28:59.327038 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:28:59.619062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:28:59.755658 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:28:59.786846 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:00.259416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:00.302998 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:00.340784 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 3300000000ad49717 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:00.341410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:00.341793 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (2048ms) {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:00.342446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:00.347144 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:00.780013 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:00.789808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:00.790045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:00.800383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:00.828646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:00.844882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:00.855932 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attempting to attach volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:29:00.862037 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]: </disk>
May 14 04:29:00.862037 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:29:00.884088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:00.884088 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:00.896223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:00.899257 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7'] 
May 14 04:29:00.899832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:00.899832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:00.899943 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:01.298465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:01.527119 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updated VIF entry in instance network info cache for port 3be17b4b-22ed-4612-9b0c-51594e6f1ba6. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:01.527756 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating instance_info_cache with network_info: [{"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:01.709333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:01.885597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:01.885597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:01.891796 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:01.892014 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Claim successful on node np0000000747
May 14 04:29:01.951631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:02.032078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-887d6d31-134c-43d5-8677-4455ccaf9321 req-97e06572-0eb8-40e8-8c4f-0de8bfffe7d3 service nova] Releasing lock "refresh_cache-c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:02.143073 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Starting finish_migration {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 04:29:02.144694 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Creating image(s)
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Ensure instance console log exists: /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:02.146633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:02.149232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start _get_guest_xml network_info=[{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1ddef5f1-9bfc-4f0e-a68f-2625425e12c6', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'ec7eb127-aa14-4632-aadd-d50696b45625', 'attached_at': '2026-05-14T04:29:01.000000', 'detached_at': '', 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'serial': '90ebb94c-0b74-48de-ba06-6488816ef98b'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:02.155869 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:02.155869 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1210740464', uuid='ec7eb127-aa14-4632-aadd-d50696b45625'), owner=OwnerMeta(userid='5a8ede1ead104b17957a4b8b20b80d6b', username='tempest-ServerActionsTestOtherA-1166153365-project-member', projectid='c6680b6e8f4e4852b7d9bb1f67e84fe6', projectname='tempest-ServerActionsTestOtherA-1166153365'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732942.1549962) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:02.160833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:02.160833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:02.163887 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:02.164371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:02.167080 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:02.167080 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:02.167394 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:02.167673 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:02.168011 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:02.168266 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:02.168533 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:02.169381 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:02.169634 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:02.171090 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:02.171090 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:02.171090 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:02.186787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:02.314043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config --force-share --output=json" returned: 0 in 0.126s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:02.314585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:02.314903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:02.316340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:02.317272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:02.318085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:02.318085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:02.318300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:02.318953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:02.336962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:02.337909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:02.340582 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:02.340919 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:02.341837 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:02.342153 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:02.355703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:02.355703 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:02.366641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:02.366641 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:02.380111 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b] added
May 14 04:29:02.380111 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:02.380111 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:02.380111 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:02.380111 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:02.380111 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:02.380111 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:02.380380 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:02.381919 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b] added
May 14 04:29:02.384119 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:02.384119 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:02.384119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:02.384762 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0421(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:02.384762 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:02.586107 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:02.586553 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:02.586553 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:02.586738 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:f4:99:43, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:03.384652 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:03.385226 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:03.402392 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:03.402392 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:03.404496 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:03.404496 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.417266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.425739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.440103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.440103 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.440103 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.440103 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.440103 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:03.440745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.440745 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.440745 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.440745 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.440745 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:03.441089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.441089 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.441089 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.441089 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.441089 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:03.442671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.442671 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.442671 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.442671 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.442671 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:03.491980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260]
May 14 04:29:03.491980 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260] successful.
May 14 04:29:03.491980 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.504197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260]
May 14 04:29:03.504197 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260] successful.
May 14 04:29:03.504197 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.514673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.526495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.540182 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.540594 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:03.540849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:03.541026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.547352 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:03.547863 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:03.548937 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:03.548937 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:03.550224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('8', '-', '-', 0) found on session 50 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:03.550224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:03.551968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] HCTL ('7', '-', '-', 0) found on session 49 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:03.552602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:03.574346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 50 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:03.574346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:03.588084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Searching for a device in session 49 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:03.588500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:03.843452 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:03.844596 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:04.188476 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aec0e382-528d-4e44-9ee7-146081ee7e4b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.671s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:04.305564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:04.342132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:04.354470 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:04.863077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.979s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:04.863653 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:05.064738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.365222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Found WWN 330000000a6571e3c for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:05.365628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:05.365945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000a6571e3c', 'path': '/dev/dm-0', 'multipath_id': '330000000a6571e3c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:05.366109 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a6571e3c', 'path': '/dev/dm-0', 'multipath_id': '330000000a6571e3c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:05.373733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:05.373946 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:05.378037 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:05.378508 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:05.841163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.882685 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:05.891347 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:36Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:05.891727 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:05.892435 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:05.906829 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <uuid>ec7eb127-aa14-4632-aadd-d50696b45625</uuid>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <name>instance-00000015</name>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <memory>262144</memory>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsTestOtherA-server-1210740464</nova:name>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:02</nova:creationTime>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.micro" id="84">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:memory>256</nova:memory>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:user uuid="5a8ede1ead104b17957a4b8b20b80d6b">tempest-ServerActionsTestOtherA-1166153365-project-member</nova:user>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:project uuid="c6680b6e8f4e4852b7d9bb1f67e84fe6">tempest-ServerActionsTestOtherA-1166153365</nova:project>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         <nova:port uuid="d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="serial">ec7eb127-aa14-4632-aadd-d50696b45625</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="uuid">ec7eb127-aa14-4632-aadd-d50696b45625</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/disk.config"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <alias name="ua-90ebb94c-0b74-48de-ba06-6488816ef98b"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <serial>90ebb94c-0b74-48de-ba06-6488816ef98b</serial>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:7a:ea:bc"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <target dev="tapd7a5f1d8-89"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625/console.log" append="off"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:05.906829 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:36Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1924658592-network", "vif_mac": "fa:16:3e:7a:ea:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:05.910405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:05.911504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.911504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e790e26f-890d-5b6e-8ed0-ba38d9371806', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:05.914149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:05.918074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.924491 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.924761 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7a5f1d8-89, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:05.925353 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7a5f1d8-89, col_values=(('qos', UUID('8133ee68-6600-49fd-86dc-492f7942626a')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:05.925627 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7a5f1d8-89, col_values=(('external_ids', {'iface-id': 'd7a5f1d8-8944-4089-b5fd-7eb0f92fde1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ea:bc', 'vm-uuid': 'ec7eb127-aa14-4632-aadd-d50696b45625'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:05.928504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.930337 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:05.936406 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:05.938680 np0000000747 nova-compute[97971]: INFO os_vif [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89')
May 14 04:29:06.384770 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:06.667215 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004218849999233498 future=<Future at 0x7435f8443bc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:06.667215 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:06.667215 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Emitting event <LifecycleEvent: 1778732931.6640732, ec7eb127-aa14-4632-aadd-d50696b45625 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:06.667215 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Stopped (Lifecycle Event)
May 14 04:29:06.954033 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:07.011507 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:07.168930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:07.171288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:07.265383 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9162ff1a39944890abe678ecdc379e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb35548693e4088a0b1c42ad4cc414a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:07.393346 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:07.394506 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:07.394799 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Creating image(s)
May 14 04:29:07.395328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:07.395551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:07.396084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:07.398393 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:07.401117 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:07.402732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:07.474646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:07.474646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:07.474646 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] No VIF found with MAC fa:16:3e:7a:ea:bc, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:07.474646 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Using config drive
May 14 04:29:07.522472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:07.524089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:07.524736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:07.525317 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:07.529542 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:07.530405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:07.644904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:07.646317 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:07.675938 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 04:29:07.743977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk 1073741824" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:07.744646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:07.745381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:07.870248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.124s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:07.870965 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:29:07.871362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:07.986169 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:07.986870 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Cannot resize image /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:29:07.987078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:29:07.987309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Ensure instance console log exists: /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:07.987588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:07.987898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:07.988060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:08.058184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.087718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.088886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.181635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.242763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.244834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:08.403914 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Successfully created port: 862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:08.689606 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:09.102510 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732949.102039, ec7eb127-aa14-4632-aadd-d50696b45625 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:09.103388 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Resumed (Lifecycle Event)
May 14 04:29:09.105074 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:09.109765 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance running successfully.
May 14 04:29:09.113420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Failed to set time: agent not configured {{(pid=97971) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 04:29:09.113420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f34af6dc-6f11-40dc-8da3-c308a3266aa2 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] finish_migration finished successfully. {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 04:29:09.608506 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:09.610872 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:09.813668 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Stashing vm_state: active {{(pid=97971) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 04:29:09.844278 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Successfully updated port: 862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:10.017101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-changed-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:10.017927 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Refreshing instance network info cache due to event network-changed-862182a1-bd43-4b5d-86d0-b817eb29999f. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:10.017927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] Acquiring lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:10.017927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] Acquired lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:10.018053 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Refreshing network info cache for port 862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:10.116023 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 04:29:10.116720 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732950.1161308, ec7eb127-aa14-4632-aadd-d50696b45625 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:10.116720 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Started (Lifecycle Event)
May 14 04:29:10.346521 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:10.398444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:10.398758 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:10.520890 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:10.620089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:10.623930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:10.630745 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:10.844916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:10.851887 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:10.919327 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:10.920083 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Claim successful on node np0000000747
May 14 04:29:10.924287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:10.924644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:10.926360 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Going to confirm migration 2 {{(pid=97971) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 04:29:10.928815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:11.310059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:11.310713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:11.355171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-955ac4c0-5152-47fe-aad5-ea2204448139 req-7c888101-4116-4b15-a496-8c54190054fe service nova] Releasing lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:11.355791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquired lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:11.355906 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:11.429770 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating resource usage from migration 7420c58e-fdbb-459e-8e83-32f90ce17c07
May 14 04:29:11.435443 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:11.535555 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:11.535923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:11.536081 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquired lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:11.536268 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:11.536451 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'info_cache' on Instance uuid ec7eb127-aa14-4632-aadd-d50696b45625 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:11.754015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:11.814012 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:11.963039 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:12.201310 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:12.212996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:12.411248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:12.474174 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Updating instance_info_cache with network_info: [{"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:12.505216 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:12.505470 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:12.547960 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:12.978984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Releasing lock "refresh_cache-3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:12.979814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance network_info: |[{"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:12.983964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Start _get_guest_xml network_info=[{"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:12.988767 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:12.990412 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-381301142', uuid='3efd7e68-1f22-4e3a-b47a-137c24a1fe8b'), owner=OwnerMeta(userid='9162ff1a39944890abe678ecdc379e27', username='tempest-ServersNegativeTestJSON-1703914415-project-member', projectid='0cb35548693e4088a0b1c42ad4cc414a', projectname='tempest-ServersNegativeTestJSON-1703914415'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732952.9898305) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:12.992522 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:12.993120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:12.996119 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:12.996510 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:12.997794 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:12.998633 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:12.998633 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:12.999605 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:12.999759 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:13.004318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:13.005021 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:13.014562 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:13.037588 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-381301142',display_name='tempest-ServersNegativeTestJSON-server-381301142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-381301142',id=25,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-ny6cd0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:06Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=3efd7e68-1f22-4e3a-b47a-137c24a1fe8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:13.037990 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:13.040370 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:13.042079 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lazy-loading 'pci_devices' on Instance uuid 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:13.163042 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:13.428366 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [{"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:13.544759 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.146s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:13.545115 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Migrating
May 14 04:29:13.545115 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:29:13.550371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.140s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:13.556160 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <uuid>3efd7e68-1f22-4e3a-b47a-137c24a1fe8b</uuid>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <name>instance-00000019</name>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServersNegativeTestJSON-server-381301142</nova:name>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:12</nova:creationTime>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:user uuid="9162ff1a39944890abe678ecdc379e27">tempest-ServersNegativeTestJSON-1703914415-project-member</nova:user>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:project uuid="0cb35548693e4088a0b1c42ad4cc414a">tempest-ServersNegativeTestJSON-1703914415</nova:project>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         <nova:port uuid="862182a1-bd43-4b5d-86d0-b817eb29999f">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="serial">3efd7e68-1f22-4e3a-b47a-137c24a1fe8b</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="uuid">3efd7e68-1f22-4e3a-b47a-137c24a1fe8b</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.config"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:c8:40:3c"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <target dev="tap862182a1-bd"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/console.log" append="off"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:13.556160 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:13.560017 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Preparing to wait for external event network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:29:13.560017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:13.560017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:13.560017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:13.560977 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-381301142',display_name='tempest-ServersNegativeTestJSON-server-381301142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-381301142',id=25,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-ny6cd0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:06Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=3efd7e68-1f22-4e3a-b47a-137c24a1fe8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:13.561161 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:13.561845 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:13.562085 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:13.562670 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:13.562843 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Claim successful on node np0000000747
May 14 04:29:13.566324 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:13.566639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:13.572006 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:13.574912 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:13.575143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99e21583-cc0b-53a2-b084-e6f214f0c96e', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:13.581963 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:13.592115 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:13.592532 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap862182a1-bd, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:13.594133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap862182a1-bd, col_values=(('qos', UUID('ddc22dd4-9503-4369-a34a-966d2fa55424')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:13.594590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap862182a1-bd, col_values=(('external_ids', {'iface-id': '862182a1-bd43-4b5d-86d0-b817eb29999f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:40:3c', 'vm-uuid': '3efd7e68-1f22-4e3a-b47a-137c24a1fe8b'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:13.596661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:13.598574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:13.605351 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:13.606442 np0000000747 nova-compute[97971]: INFO os_vif [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd')
May 14 04:29:13.615058 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:13.615839 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:29:13.810421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:13.810713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:13.933927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Releasing lock "refresh_cache-ec7eb127-aa14-4632-aadd-d50696b45625" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:13.933927 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'migration_context' on Instance uuid ec7eb127-aa14-4632-aadd-d50696b45625 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:14.090850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:14.091021 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:14.091285 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:14.317134 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:14.333108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:14.436346 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Object Instance<ec7eb127-aa14-4632-aadd-d50696b45625> lazy-loaded attributes: info_cache,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:14.437517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:14.595810 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:14.610375 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:14.610786 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:14.611925 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:29:14.910067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:15.057106 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:15.138721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:15.139634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:15.139634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No VIF found with MAC fa:16:3e:c8:40:3c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:15.139634 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Using config drive
May 14 04:29:15.271980 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:15.603015 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:15.604419 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:29:15.610260 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:15.610260 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:15.610260 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:29:15.610422 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:15.647412 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:15.695497 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:15.695789 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:15.774671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:15.817122 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Creating config drive at /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.config
May 14 04:29:15.820541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpci361l45 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:15.850729 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:15.886024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpci361l45" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:16.116485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:16.199817 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:16.402914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.438841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.439877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.562739 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.713400 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.163s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:16.714082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:16.719372 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.277s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:16.843083 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.849333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.854257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:16.871980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.228738 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:17.229015 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:17.229529 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:17.229835 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:17.262541 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:17.262794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:17.263223 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:17.263339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:17.263473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:17.263609 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-4c87c932-0620-4235-9117-bfe702f7f62d req-1c8874a8-6517-4497-92eb-b97dc4a470ab service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received unexpected event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with vm_state resized and task_state None.
May 14 04:29:17.291871 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Starting migrate_disk_and_power_off {{(pid=97971) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 04:29:17.325269 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.353002 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.372518 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b73f8491edc4c59b345fbd4d3b6c6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3030a0d75e9c41828981f529272fd47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:17.439676 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732957.4382966, 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:17.439676 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] VM Started (Lifecycle Event)
May 14 04:29:17.495359 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.504534 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.605074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.624184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.654411 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance destroyed successfully.
May 14 04:29:17.656263 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:21Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:17.656437 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:17.657279 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:17.657514 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:17.662491 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.662491 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79ffd091-d1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:17.662491 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.662952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:17.666065 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.667275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.668052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36b0eae6-b3f2-4540-8c49-f745ea1bb705) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:17.668052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:17.668437 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:17.671560 np0000000747 nova-compute[97971]: INFO os_vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1')
May 14 04:29:17.733510 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:17.942579 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:17.946289 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732957.9459906, 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:17.946465 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] VM Paused (Lifecycle Event)
May 14 04:29:18.227064 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Detected multiple connections on this host for volume: f4c52872-aa09-405c-a76c-6fe1f7b26e53, skipping target disconnect.
May 14 04:29:18.231253 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:18.246993 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:18.283846 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:18.283846 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:18.342147 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Successfully created port: 7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:18.347622 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:18.348309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:18.442106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:18.443386 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:29:18.443386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:18.457493 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:18.464011 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:18.551897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:18.552295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk.config /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:18.600595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk.config /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config" returned: 0 in 0.047s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:18.600595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk.info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:18.644147 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_resize/disk.info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" returned: 0 in 0.043s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:18.789260 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:18.968639 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:29:18.972403 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99879027399993 future=<Future at 0x74361bf548f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:18.973328 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99635772900001 future=<Future at 0x74361bf548f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:18.974690 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.994665150999936 future=<Future at 0x74361bf548f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:19.035994 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Successfully updated port: 7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:19.157304 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-changed-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.157517 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Refreshing instance network info cache due to event network-changed-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:19.157725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] Acquiring lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:19.157848 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] Acquired lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:19.157985 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Refreshing network info cache for port 7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Creating image(s)
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.266300 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:19.270291 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:19.279886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:19.376089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.376365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received unexpected event network-vif-plugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with vm_state resized and task_state None.
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] No event matching network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f in dict_keys([('network-vif-plugged', '862182a1-bd43-4b5d-86d0-b817eb29999f')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:29:19.377633 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received unexpected event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f for instance with vm_state building and task_state spawning.
May 14 04:29:19.377995 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.377995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.378064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.378474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.378599 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Processing event network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:29:19.378788 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.378954 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.378995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.379068 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.379172 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] No waiting events found dispatching network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:19.379273 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received unexpected event network-vif-plugged-862182a1-bd43-4b5d-86d0-b817eb29999f for instance with vm_state building and task_state spawning.
May 14 04:29:19.379363 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.379466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.379919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.380015 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] No waiting events found dispatching network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received unexpected event network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 for instance with vm_state active and task_state resize_migrating.
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.380696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.381196 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] No waiting events found dispatching network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:19.381196 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received unexpected event network-vif-unplugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 for instance with vm_state active and task_state resize_migrating.
May 14 04:29:19.381196 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:19.381196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.381305 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.382878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.382878 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:19.382878 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] No waiting events found dispatching network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:19.382878 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0d732b4d-af8d-434b-b1e1-1765ba5b5b6b req-1382dd3f-8184-4e55-af74-66ac386ca364 service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received unexpected event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b for instance with vm_state building and task_state spawning.
May 14 04:29:19.385554 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732959.385125, 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:19.385891 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] VM Resumed (Lifecycle Event)
May 14 04:29:19.387865 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:29:19.390573 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance spawned successfully.
May 14 04:29:19.391039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:29:19.406164 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.128s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:19.412461 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.413508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.413819 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:19.418980 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:19.419490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:19.539772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:19.542995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:19.544008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:19.613965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk 1073741824" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:19.613965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.613965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:19.664236 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:19.734863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:19.735370 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:29:19.735655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:19.777496 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:19.819093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.104s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.823301 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.910s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.827748 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:19.827935 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Claim successful on node np0000000747
May 14 04:29:19.832545 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:19.832545 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:19.839047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:19.839401 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Cannot resize image /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:29:19.839762 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:29:19.840163 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Ensure instance console log exists: /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:19.840305 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:19.840535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:19.840726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:19.890199 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:19.892594 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:19.902816 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.902995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.903583 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.903972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.904380 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.904812 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:19.942283 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Port 79ffd091-d1b4-40f2-a837-e3aea3edff11 binding to destination host np0000000747 is already ACTIVE {{(pid=97971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 04:29:19.983408 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:20.397298 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:29:20.411243 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Took 13.02 seconds to spawn the instance on the hypervisor.
May 14 04:29:20.411409 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:20.485487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2bec8d03-eefb-4801-a584-195d58583351 req-6b18ecf2-d8b5-4c28-8473-5919a7d086ee service nova] Releasing lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:20.486710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:20.487164 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:20.494252 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Deleted allocation for migration 89008991-18a2-4b28-a320-cc429ce1f46a
May 14 04:29:20.712236 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-795a84d2-503c-4d7d-896d-4b3e3120eb28 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Get console output
May 14 04:29:20.826705 np0000000747 nova-compute[97971]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 14 04:29:20.850893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:20.931694 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Took 19.12 seconds to build instance.
May 14 04:29:20.958404 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:29:20.976375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:20.976722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:20.976924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:21.004207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7a37e616-d472-453f-a87e-bc6c99db7ed1 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 10.079s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:21.086264 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:21.332814 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:21.433506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7722321f-e54a-42bd-a628-0c6fad2433db tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.643s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:21.581504 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Updating instance_info_cache with network_info: [{"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:21.817137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:21.817429 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:21.989644 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:22.070480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:22.070480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:22.070480 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:22.085514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-4d665afc-c146-44a9-af0b-e36fcd96568a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:22.087823 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance network_info: |[{"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:22.088426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Start _get_guest_xml network_info=[{"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:22.097703 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:22.097703 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1010121184', uuid='4d665afc-c146-44a9-af0b-e36fcd96568a'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732962.097113) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:22.098767 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:22.099299 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:22.102083 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:22.103630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:22.104852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:22.105462 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:22.105728 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:22.105875 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:22.106031 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:22.106190 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:22.106335 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:22.106980 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:22.107189 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:22.107360 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:22.107540 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:22.107747 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:22.129119 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1010121184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1010121184',id=26,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-c3xn2dv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:18Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=4d665afc-c146-44a9-af0b-e36fcd96568a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:22.129390 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:22.130014 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:22.135296 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d665afc-c146-44a9-af0b-e36fcd96568a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:22.218496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:22.219237 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:22.324388 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:22.572812 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:22.640717 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <uuid>4d665afc-c146-44a9-af0b-e36fcd96568a</uuid>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <name>instance-0000001a</name>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1010121184</nova:name>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:22</nova:creationTime>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         <nova:port uuid="7f73ecfa-7252-48cd-bdcd-3f0f3da9776b">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="serial">4d665afc-c146-44a9-af0b-e36fcd96568a</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="uuid">4d665afc-c146-44a9-af0b-e36fcd96568a</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.config"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:a4:7f:5f"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <target dev="tap7f73ecfa-72"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/console.log" append="off"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:22.640717 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Preparing to wait for external event network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1010121184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1010121184',id=26,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-c3xn2dv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:18Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=4d665afc-c146-44a9-af0b-e36fcd96568a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:22.642507 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:22.644202 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:22.645673 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:22.645673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.645907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:22.646152 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:22.649849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.650035 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d3f1c38-5c6b-536e-a38a-b9c00aed7c93', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:22.650758 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.651450 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:22.652529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.658723 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.658937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f73ecfa-72, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:22.659332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f73ecfa-72, col_values=(('qos', UUID('60ab19f6-2be3-47ab-9e75-196ef564764c')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:22.659513 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f73ecfa-72, col_values=(('external_ids', {'iface-id': '7f73ecfa-7252-48cd-bdcd-3f0f3da9776b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7f:5f', 'vm-uuid': '4d665afc-c146-44a9-af0b-e36fcd96568a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:22.663204 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.664532 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:22.668105 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:22.669170 np0000000747 nova-compute[97971]: INFO os_vif [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72')
May 14 04:29:22.723168 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:22.833415 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.014s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:22.833836 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:22.836319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 6.718s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:22.839553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.006s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:22.841635 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:29:22.983256 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:23.053889 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:23.054373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:23.149038 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:23.290875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:23.291494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:23.297142 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:23.297537 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Claim successful on node np0000000747
May 14 04:29:23.344826 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:23.348753 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:23.348753 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:23.348753 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:23.472168 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee1ac8dfdafb41e8970f194512d19939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35a824e8e9c463dba8bc365f617dc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:23.558337 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'flavor' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:23.650991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:23.850638 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:23.886750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:23.991258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:23.991997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.072295 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Successfully created port: b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:24.092517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.110709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.165345 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:24.177264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:24.195748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:24.195748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:24.195748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:a4:7f:5f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:24.195748 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Using config drive
May 14 04:29:24.202972 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.234389 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.236324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.259920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:24.261525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:24.272385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:24.274216 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0'] 
May 14 04:29:24.274463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:24.275207 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:24.275530 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:24.339754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.340166 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:29:24.347140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.370770 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:24.452055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.452479 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.562103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.566259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.585638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.528s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:24.677304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.677793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.713422 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:24.791861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.792947 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000001a, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.config'
May 14 04:29:24.801408 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Successfully updated port: b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:24.804494 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:29:24.806136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.919480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:24.922800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:24.958503 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Creating config drive at /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.config
May 14 04:29:24.979091 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9dgbaa8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.034321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.038290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9dgbaa8" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.038793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.135885 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-changed-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:25.137321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Refreshing instance network info cache due to event network-changed-b9e6deb4-f0c6-4606-937a-0708ccb3d207. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:25.137321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] Acquiring lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:25.137497 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] Acquired lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:25.137663 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Refreshing network info cache for port b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:25.146655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.147933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.252374 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.255945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.328721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:25.374413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.376193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.402560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:25.410217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:25.410217 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Creating image(s)
May 14 04:29:25.411135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:25.411542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:25.425250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:25.426040 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:25.434818 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:25.435556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.487152 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.492785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.555501 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.555985 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:25.556509 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:25.557167 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:25.563164 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:25.564373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.592985 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Starting finish_migration {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 04:29:25.597940 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:29:25.597940 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Creating image(s)
May 14 04:29:25.598867 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:25.606447 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.638487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.640651 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:25.645726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.666232 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:25.685761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.117s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.686413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.714820 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:25.721432 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.016s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:25.721432 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attaching volume 608c3b18-74ef-4872-b778-0659c2525b01 to /dev/vdb
May 14 04:29:25.740858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:25.749709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.142s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.753421 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:29:25.753717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.803443 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.805050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk 1073741824" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.811438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:25.811584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.836093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.854157 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:25.892595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.893647 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:29:25.927201 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:25.933036 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:25.942927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.944590 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:29:25.945144 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:25.974757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:25.979949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:25.991875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.041502 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.059351 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.063205 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:26.069678 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Cannot resize image /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:29:26.094446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:29:26.094676 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Ensure instance console log exists: /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:26.098062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:26.100635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:26.100635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:26.101115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:26.101415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:26.112409 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:26.112723 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:26.115758 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:26.119564 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf'] 
May 14 04:29:26.119564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:26.119564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:26.119564 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:26.119564 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating existing volume attachment record: fb139493-0452-4cdd-8dd6-5a7bd8a6fec8 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:26.148724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.149198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:29:26.154426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:29:26.156451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.281605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.284818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.304440 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:26.395177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.400819 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:29:26.401113 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Ensure instance console log exists: /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:26.401585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:26.402176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:26.402176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:26.408768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.410591 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start _get_guest_xml network_info=[{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '78573e91-d53f-41f0-8ddd-83907f706de6', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '3370940d-3bd7-45f3-887f-9c515137a348', 'attached_at': '2026-05-14T04:29:24.000000', 'detached_at': '', 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'multiattach': True, 'serial': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:26.437200 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:26.439221 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='3370940d-3bd7-45f3-887f-9c515137a348'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732966.4382179) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:26.442002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:26.442766 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:26.444017 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:26.444332 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:26.446874 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:26.447571 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:26.447800 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:26.448435 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:26.448435 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:26.448435 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:26.448435 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:26.448435 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:26.448762 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:26.448762 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:26.448861 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:26.448928 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:26.471252 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.525258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.527165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.594362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.595266 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:26.595356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:26.596104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:26.597385 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:26.597385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:26.597385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:26.597749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:26.598041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:26.613686 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:26.614543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:26.614543 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:26.618204 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:26.630909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:26.637866 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.018s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:26.638932 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:26.639795 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:26.639795 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:26.648757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.650484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.676809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:26.679563 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:26.679563 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:26.697473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.711702 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.713676 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:26.714655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.100s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:26.715510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.716474 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:26.717489 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:26.718201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:26.718448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:26.719406 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:26.719818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:26.719973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:26.722080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '0', '0', 0) found on session 48 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:26.722396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:26.723425 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '0', '0', 0) found on session 47 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:26.723425 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:26.737652 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 47 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:26.738416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:26.738812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 48 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:26.740962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:26.773741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.775139 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.811118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a8bd42-7ff1-4435-9a53-289f0b395a4b req-b5783436-2050-446e-9d37-2bea73327c6b service nova] Releasing lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:26.812629 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquired lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:26.813067 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:26.825463 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732966.8215861, 4d665afc-c146-44a9-af0b-e36fcd96568a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:26.825463 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] VM Started (Lifecycle Event)
May 14 04:29:26.875832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.881637 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:26.881637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:26.932189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:26.932786 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=10968MB free_disk=73.16687774658203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:29:26.933373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:27.145642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.853s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:27.145642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:27.148690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.215s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:27.207745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Processing event network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] No waiting events found dispatching network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:27.210097 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-eec6e520-5929-4ada-80a9-0474b8a601bf req-49299122-1222-42f6-b274-87e1ec3cb3de service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received unexpected event network-vif-plugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b for instance with vm_state building and task_state spawning.
May 14 04:29:27.211837 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:27.214706 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:29:27.216808 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance spawned successfully.
May 14 04:29:27.217258 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:29:27.333629 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:27.341032 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:27.428577 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:27.631833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:27.650428 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:27.672229 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:27.674276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:27.676073 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:27.676726 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:27.676822 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:27.723580 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.723752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.724118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.724569 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.724979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.725162 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:27.802903 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9162ff1a39944890abe678ecdc379e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb35548693e4088a0b1c42ad4cc414a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:27.845461 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:29:27.845461 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732967.845048, 4d665afc-c146-44a9-af0b-e36fcd96568a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:27.845461 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] VM Paused (Lifecycle Event)
May 14 04:29:27.896050 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Updating instance_info_cache with network_info: [{"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:28.187923 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Applying migration context for instance 3370940d-3bd7-45f3-887f-9c515137a348 as it has an incoming, in-progress migration 7420c58e-fdbb-459e-8e83-32f90ce17c07. Migration status is post-migrating {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 14 04:29:28.190484 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:28.191700 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating resource usage from migration 7420c58e-fdbb-459e-8e83-32f90ce17c07
May 14 04:29:28.238093 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Took 8.98 seconds to spawn the instance on the hypervisor.
May 14 04:29:28.238564 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:28.273765 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.274275 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275160 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275160 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5d42ebce-6d76-4893-b335-bceb7181a83a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275160 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 09eb687f-f8dd-4062-b883-f2211b86533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275736 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275736 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 85a9913c-942d-4796-86b3-dc12a56ee6fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275736 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance a7b6e4bf-576f-438e-907f-71fef72b19b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275892 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.275941 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ec7eb127-aa14-4632-aadd-d50696b45625 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.276234 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.276234 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Migration 7420c58e-fdbb-459e-8e83-32f90ce17c07 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 04:29:28.276530 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3370940d-3bd7-45f3-887f-9c515137a348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.276692 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4d665afc-c146-44a9-af0b-e36fcd96568a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.276860 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5c1dc166-7639-43d8-8405-2c173c69abaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.277792 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5dd25918-783f-427b-9af7-0bcbd702089f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:29:28.315317 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Successfully created port: c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:28.352321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:28.354180 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732968.3538234, 4d665afc-c146-44a9-af0b-e36fcd96568a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:28.354382 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] VM Resumed (Lifecycle Event)
May 14 04:29:28.397470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Releasing lock "refresh_cache-5c1dc166-7639-43d8-8405-2c173c69abaa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:28.397868 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance network_info: |[{"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:28.400031 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Start _get_guest_xml network_info=[{"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:28.402885 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:28.404294 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1410559882', uuid='5c1dc166-7639-43d8-8405-2c173c69abaa'), owner=OwnerMeta(userid='ee1ac8dfdafb41e8970f194512d19939', username='tempest-VolumesActionsTest-657133820-project-member', projectid='b35a824e8e9c463dba8bc365f617dc3a', projectname='tempest-VolumesActionsTest-657133820'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732968.40387) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:28.408441 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:28.409042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:28.409867 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:28.410476 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:28.411454 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:28.411909 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:28.412205 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:28.413630 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:28.425895 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410559882',display_name='tempest-VolumesActionsTest-instance-1410559882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-1410559882',id=27,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35a824e8e9c463dba8bc365f617dc3a',ramdisk_id='',reservation_id='r-5h2bdx0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-657133820',owner_user_name='tempest-VolumesActionsTest-657133820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:24Z,user_data=None,user_id='ee1ac8dfdafb41e8970f194512d19939',uuid=5c1dc166-7639-43d8-8405-2c173c69abaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:28.426405 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converting VIF {"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:28.427259 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:28.428050 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c1dc166-7639-43d8-8405-2c173c69abaa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:28.553855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.653072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 3300000000ad49717 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:28.653470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.056s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:28.653815 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (2056ms) {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:28.653947 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:28.654559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.935s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:28.654859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:28.675230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:28.676003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:28.678260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:28.680105 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:28.680448 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:28.680874 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:28.698132 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:28.703457 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:28.703457 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:28.711215 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:28.711215 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01] added
May 14 04:29:28.722540 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:28.722540 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:28.722540 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01] added
May 14 04:29:28.726605 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:28.726605 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:28.726605 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:28.726869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:28.727003 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0466(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:28.727127 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:28.749383 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Took 16.43 seconds to build instance.
May 14 04:29:28.783220 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 has allocations against this compute host but is not found in the database.
May 14 04:29:28.783570 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:29:28.783856 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=3712MB phys_disk=95GB used_disk=14GB total_vcpus=12 used_vcpus=16 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:29:26 up 29 min,  2 users,  load average: 10.92, 7.01, 3.35\n', 'num_instances': '15', 'num_vm_active': '11', 'num_task_None': '12', 'num_os_type_None': '15', 'num_proj_c6680b6e8f4e4852b7d9bb1f67e84fe6': '2', 'io_workload': '3', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '5', 'num_proj_cfaef82fed39403a80c7ec4baa8ad091': '3', 'num_vm_rescued': '1', 'num_task_resize_finish': '1', 'num_proj_59f783f79d26485a8347214b526fd33a': '1', 'num_proj_0cb35548693e4088a0b1c42ad4cc414a': '2', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_3030a0d75e9c41828981f529272fd47f': '1', 'num_proj_b35a824e8e9c463dba8bc365f617dc3a': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:29:28.853184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:28.855317 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:28.861667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:28.870316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:28.932480 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <uuid>5c1dc166-7639-43d8-8405-2c173c69abaa</uuid>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <name>instance-0000001b</name>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesActionsTest-instance-1410559882</nova:name>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:28</nova:creationTime>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:user uuid="ee1ac8dfdafb41e8970f194512d19939">tempest-VolumesActionsTest-657133820-project-member</nova:user>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:project uuid="b35a824e8e9c463dba8bc365f617dc3a">tempest-VolumesActionsTest-657133820</nova:project>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         <nova:port uuid="b9e6deb4-f0c6-4606-937a-0708ccb3d207">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="serial">5c1dc166-7639-43d8-8405-2c173c69abaa</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="uuid">5c1dc166-7639-43d8-8405-2c173c69abaa</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.config"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:61:24:7e"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <target dev="tapb9e6deb4-f0"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/console.log" append="off"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:28.932480 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:28.934754 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Preparing to wait for external event network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:29:28.934754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:28.934754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:28.934754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:28.934873 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410559882',display_name='tempest-VolumesActionsTest-instance-1410559882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-1410559882',id=27,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35a824e8e9c463dba8bc365f617dc3a',ramdisk_id='',reservation_id='r-5h2bdx0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-657133820',owner_user_name='tempest-VolumesActionsTest-657133820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:24Z,user_data=None,user_id='ee1ac8dfdafb41e8970f194512d19939',uuid=5c1dc166-7639-43d8-8405-2c173c69abaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:28.935033 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converting VIF {"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:28.935857 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:28.936126 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:28.937424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.937424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:28.937424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:28.939824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.939824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eae39dd2-9596-5583-a6d9-fb5018882eaa', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:28.941524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.941524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:28.942140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.946166 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.952260 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9e6deb4-f0, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:28.952260 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9e6deb4-f0, col_values=(('qos', UUID('ed5e8267-c5f7-4f0d-abf1-936682313b34')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:28.952260 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9e6deb4-f0, col_values=(('external_ids', {'iface-id': 'b9e6deb4-f0c6-4606-937a-0708ccb3d207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:24:7e', 'vm-uuid': '5c1dc166-7639-43d8-8405-2c173c69abaa'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:28.955374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:28.959435 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:28.962336 np0000000747 nova-compute[97971]: INFO os_vif [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0')
May 14 04:29:28.973290 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Successfully updated port: c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:29.056445 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-changed-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:29.057068 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Refreshing instance network info cache due to event network-changed-c227d380-e20a-44db-af58-c1bdb1c56860. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:29.057274 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] Acquiring lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:29.057404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] Acquired lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:29.057589 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Refreshing network info cache for port c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:29.162862 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:21Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:29.163129 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:29.163566 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:29.169132 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <uuid>3370940d-3bd7-45f3-887f-9c515137a348</uuid>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <name>instance-00000014</name>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <memory>262144</memory>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-0</nova:name>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:26</nova:creationTime>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.micro" id="84">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:memory>256</nova:memory>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         <nova:port uuid="79ffd091-d1b4-40f2-a837-e3aea3edff11">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="serial">3370940d-3bd7-45f3-887f-9c515137a348</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="uuid">3370940d-3bd7-45f3-887f-9c515137a348</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk.config"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-6"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <shareable/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:78:d7:1a"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <target dev="tap79ffd091-d1"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/console.log" append="off"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:29.169132 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:21Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:78:d7:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:29.172559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:29.175179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.175270 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8008a74c-c676-5b5a-8965-d4ee5e8d32b7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:29.177092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.177481 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:29.184799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.190545 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.190851 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79ffd091-d1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:29.191262 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79ffd091-d1, col_values=(('qos', UUID('9feef903-72f3-438f-9c2b-4bee51483568')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:29.191444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79ffd091-d1, col_values=(('external_ids', {'iface-id': '79ffd091-d1b4-40f2-a837-e3aea3edff11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d7:1a', 'vm-uuid': '3370940d-3bd7-45f3-887f-9c515137a348'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:29.193908 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:29.206939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:29.208588 np0000000747 nova-compute[97971]: INFO os_vif [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1')
May 14 04:29:29.251904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be868f8a-70d9-4da6-af99-6348ce7401cf tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.941s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:29.362937 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:29.481320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:29.561057 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:29.647698 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:29.712132 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:29.713877 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:29.714566 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Creating image(s)
May 14 04:29:29.715055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:29.715258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:29.715723 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:29.716270 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:29.719327 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:29.721124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:29.746274 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:29.750710 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:29.761431 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:29.761431 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:29.778994 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:29.778994 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.785307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.793754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.804463 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.804710 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:29.805739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:29.806306 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.811150 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.811368 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:29.827275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:29.827770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:29.828328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:29.829141 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:29.835659 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:29.835659 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:29.862124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.50.100,3260]
May 14 04:29:29.862124 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.50.100,3260] successful.
May 14 04:29:29.862124 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.881480 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:29.884143 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.884516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.40.100,3260]
May 14 04:29:29.884516 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.40.100,3260] successful.
May 14 04:29:29.884516 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.903720 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:29.905000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:29.905000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:29.906510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] HCTL ('13', '-', '-', 0) found on session 51 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:29.906510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching for a device in session 51 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:29.930829 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:29.930829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:29.932570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] HCTL ('14', '-', '-', 0) found on session 52 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:29.932840 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:29.937019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:29.937479 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:29.970070 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching for a device in session 52 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:29.970814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:29.992420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:30.010025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk 1073741824" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:30.010258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:30.010451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:30.145875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.135s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:30.146880 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:29:30.146880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:30.253121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:30.254462 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Cannot resize image /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:29:30.254462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:29:30.254462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Ensure instance console log exists: /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:30.254879 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:30.255233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:30.255485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:30.311388 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:30.387072 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7aab8ab2-710c-41ee-baf4-504be75619b2 req-bc874221-9ba6-46da-86e7-526f6eac81cb service nova] Releasing lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:30.388313 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquired lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:30.388313 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:30.496246 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:30.496382 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:30.496486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] No VIF found with MAC fa:16:3e:61:24:7e, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:30.497089 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Using config drive
May 14 04:29:30.564472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:30.679261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:30.750209 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:30.752216 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:30.752216 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:30.752216 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:78:d7:1a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:30.752216 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Using config drive
May 14 04:29:30.821900 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:29:30.822104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.674s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:30.822536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.830s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:30.822940 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:29:30.825706 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:30.825844 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Claim successful on node np0000000747
May 14 04:29:30.864029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:30.985386 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:31.003316 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:31.072109 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] instance snapshotting
May 14 04:29:31.191894 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:31.200253 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Creating config drive at /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.config
May 14 04:29:31.204339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9gj8v34f {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:31.250245 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.274693 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Beginning live snapshot process
May 14 04:29:31.282645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9gj8v34f" returned: 0 in 0.077s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:31.297649 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.300821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.396925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.408561 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Updating instance_info_cache with network_info: [{"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:31.446321 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.452194 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.543477 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:31.543885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:31.544190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:31.545419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:31.547362 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] No waiting events found dispatching network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:31.547362 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-07e8d59d-eff0-4aa7-9093-2c5bfd3a9f78 req-712e2054-b900-4adb-93da-e20a4362ac3d service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received unexpected event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 for instance with vm_state active and task_state resize_finish.
May 14 04:29:31.699173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Found WWN 3300000003573d0e6 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:31.699711 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:31.699897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] <== connect_volume: return (4980ms) {'type': 'block', 'scsi_wwn': '3300000003573d0e6', 'path': '/dev/dm-7', 'multipath_id': '3300000003573d0e6'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:31.700088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003573d0e6', 'path': '/dev/dm-7', 'multipath_id': '3300000003573d0e6'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:31.708119 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'flavor' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:31.912527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Releasing lock "refresh_cache-5dd25918-783f-427b-9af7-0bcbd702089f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:31.914953 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance network_info: |[{"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:31.915352 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Start _get_guest_xml network_info=[{"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:31.920424 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:31.922236 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-876234790', uuid='5dd25918-783f-427b-9af7-0bcbd702089f'), owner=OwnerMeta(userid='9162ff1a39944890abe678ecdc379e27', username='tempest-ServersNegativeTestJSON-1703914415-project-member', projectid='0cb35548693e4088a0b1c42ad4cc414a', projectname='tempest-ServersNegativeTestJSON-1703914415'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732971.9216802) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:31.933604 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:31.934059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:31.940204 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:31.940461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:31.943883 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:31.944371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:31.944371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:31.944371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:31.955233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:31.970222 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-876234790',display_name='tempest-ServersNegativeTestJSON-server-876234790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-876234790',id=28,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-6cfm0bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:29Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=5dd25918-783f-427b-9af7-0bcbd702089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:31.970642 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:31.971412 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:31.972144 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dd25918-783f-427b-9af7-0bcbd702089f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:31.993587 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.003376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.093201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.211004 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attempting to attach volume 608c3b18-74ef-4872-b778-0659c2525b01 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:29:32.212314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:   <alias name="ua-608c3b18-74ef-4872-b778-0659c2525b01"/>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:   <serial>608c3b18-74ef-4872-b778-0659c2525b01</serial>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]: </disk>
May 14 04:29:32.212314 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:29:32.334001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.336335 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.342468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.368530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.478242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <uuid>5dd25918-783f-427b-9af7-0bcbd702089f</uuid>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <name>instance-0000001c</name>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServersNegativeTestJSON-server-876234790</nova:name>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:31</nova:creationTime>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:user uuid="9162ff1a39944890abe678ecdc379e27">tempest-ServersNegativeTestJSON-1703914415-project-member</nova:user>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:project uuid="0cb35548693e4088a0b1c42ad4cc414a">tempest-ServersNegativeTestJSON-1703914415</nova:project>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         <nova:port uuid="c227d380-e20a-44db-af58-c1bdb1c56860">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="serial">5dd25918-783f-427b-9af7-0bcbd702089f</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="uuid">5dd25918-783f-427b-9af7-0bcbd702089f</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.config"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:46:5a:9a"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <target dev="tapc227d380-e2"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/console.log" append="off"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:32.478242 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:32.480214 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Preparing to wait for external event network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:29:32.480214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:32.480214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:32.480214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-876234790',display_name='tempest-ServersNegativeTestJSON-server-876234790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-876234790',id=28,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-6cfm0bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:29Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=5dd25918-783f-427b-9af7-0bcbd702089f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.485310 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:32.485955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:32.487826 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.488031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9638599-c958-5017-81b9-bd6f5f5d6d86', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:32.489907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.489907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:32.490831 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.494719 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.494865 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc227d380-e2, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:32.495212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc227d380-e2, col_values=(('qos', UUID('a0c569b2-dee7-48a0-b446-b6f2224ba00f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:32.495357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc227d380-e2, col_values=(('external_ids', {'iface-id': 'c227d380-e20a-44db-af58-c1bdb1c56860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:5a:9a', 'vm-uuid': '5dd25918-783f-427b-9af7-0bcbd702089f'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:32.497349 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.498865 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:32.504161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:32.505089 np0000000747 nova-compute[97971]: INFO os_vif [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2')
May 14 04:29:32.789322 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 3370940d-3bd7-45f3-887f-9c515137a348 due to new event <LifecycleEvent: 1778732972.7870378, 3370940d-3bd7-45f3-887f-9c515137a348 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:29:32.789910 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:32.790684 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732972.7870378, 3370940d-3bd7-45f3-887f-9c515137a348 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:32.790770 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Resumed (Lifecycle Event)
May 14 04:29:32.796877 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance running successfully.
May 14 04:29:32.798690 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Failed to set time: agent not configured {{(pid=97971) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 04:29:32.798758 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e1e1fb6-cb2d-490b-ac3e-b988f770b4f9 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] finish_migration finished successfully. {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 04:29:32.804698 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:32.897706 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:32.899555 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:32.929525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json -f qcow2" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:32.930422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:33.032526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json -f qcow2" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:33.033788 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:33.037158 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:33.037610 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:33.146362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:33.146812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c.delta 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:33.208553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c.delta 1073741824" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:33.209034 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 04:29:33.295648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:33.296636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:33.404337 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:33.480595 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:29:33.482275 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 04:29:33.523553 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:29:33.523958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c.delta /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:33.625572 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:33.625856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:33.626059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:33.626185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:33.626309 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] No waiting events found dispatching network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:33.626417 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received unexpected event network-vif-plugged-79ffd091-d1b4-40f2-a837-e3aea3edff11 for instance with vm_state resized and task_state None.
May 14 04:29:33.626519 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:33.627049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:33.627213 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:33.627407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:33.627580 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Processing event network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:29:33.627805 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:33.628004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:33.628214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:33.628387 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:33.628510 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] No waiting events found dispatching network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:33.628982 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e81d78a7-0937-4d10-9913-6f0c0e7b437c req-311d9a3e-85c5-434c-96e9-69391ecb61ae service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received unexpected event network-vif-plugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 for instance with vm_state building and task_state spawning.
May 14 04:29:33.630308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:33.634028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:29:33.635508 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance spawned successfully.
May 14 04:29:33.635777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:29:33.649356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c.delta /opt/stack/data/nova/instances/snapshots/tmp4aswq984/1eca7d5e9a5b4cd3a418ebbed138e09c" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:33.650571 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Snapshot extracted, beginning image upload
May 14 04:29:33.799597 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 04:29:33.799945 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732973.7997043, 3370940d-3bd7-45f3-887f-9c515137a348 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:33.800052 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Started (Lifecycle Event)
May 14 04:29:33.823315 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:29:33.823803 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.79 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:29:33.913929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.091s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:33.914400 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:33.923760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:33.923873 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:33.924045 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:33.924208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:9c:b8:5b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:33.970988 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.001618978000124116 future=<Future at 0x74361bf548f0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:33.971387 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:34.029749 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:34.029854 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:34.029996 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] No VIF found with MAC fa:16:3e:46:5a:9a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:34.030430 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Using config drive
May 14 04:29:34.145551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.145729 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.145972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.146210 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.146488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.146807 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:34.303277 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:34.311278 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:34.422864 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:34.423407 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:34.423751 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:34.424148 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:34.540879 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:34.653642 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Took 9.25 seconds to spawn the instance on the hypervisor.
May 14 04:29:34.653642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:34.732609 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '640e693a251443fdb4b297994247b01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434cba1835e7445d88c5e06f8000f80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:34.748630 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Creating config drive at /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.config
May 14 04:29:34.761706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb7a5i2my {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:34.815466 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732974.8148882, 5c1dc166-7639-43d8-8405-2c173c69abaa => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:34.815844 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] VM Started (Lifecycle Event)
May 14 04:29:34.822842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb7a5i2my" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:34.908527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:34.909111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:34.909407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Going to confirm migration 3 {{(pid=97971) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 04:29:34.927030 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:35.165242 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Took 20.34 seconds to build instance.
May 14 04:29:35.321250 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:35.329809 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:35.358271 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:35.423636 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:35.427911 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully created port: 679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:35.435902 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:35.498016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:35.498193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:35.520663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9793f08-c5a9-4582-9eb8-a0e407160ea1 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.802s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:35.578179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:35.599303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:35.660186 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a7723567-5662-4ec7-9e5f-2a4c563873d4 req-0339fc28-1b65-456e-99ad-26afbeb19b23 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:35.663175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7723567-5662-4ec7-9e5f-2a4c563873d4 req-0339fc28-1b65-456e-99ad-26afbeb19b23 service nova] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:35.663384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7723567-5662-4ec7-9e5f-2a4c563873d4 req-0339fc28-1b65-456e-99ad-26afbeb19b23 service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:35.663817 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7723567-5662-4ec7-9e5f-2a4c563873d4 req-0339fc28-1b65-456e-99ad-26afbeb19b23 service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:35.663817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a7723567-5662-4ec7-9e5f-2a4c563873d4 req-0339fc28-1b65-456e-99ad-26afbeb19b23 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Processing event network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:29:35.672014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.861s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:35.681897 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:35.682402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:35.682569 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:35.682753 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:35.682959 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'info_cache' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:35.837199 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732975.836829, 5c1dc166-7639-43d8-8405-2c173c69abaa => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:35.837383 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] VM Paused (Lifecycle Event)
May 14 04:29:35.864894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:35.911448 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Rescuing
May 14 04:29:35.912062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:35.912062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:35.912062 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:36.002124 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:36.060452 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully created port: 071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:36.342529 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:36.348566 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732976.347767, 5c1dc166-7639-43d8-8405-2c173c69abaa => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:36.348566 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] VM Resumed (Lifecycle Event)
May 14 04:29:36.415033 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:36.459363 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:36.507916 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Ignoring supplied device name: /dev/vdb
May 14 04:29:36.543102 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:29:36.550167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:29:36.554496 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance spawned successfully.
May 14 04:29:36.555428 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:29:36.602530 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully created port: ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:36.689411 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:36.812847 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Snapshot image upload complete
May 14 04:29:36.813231 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6a9578bf-e2ea-47c0-8f88-8c1af67f9f15 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Took 5.74 seconds to snapshot the instance on the hypervisor.
May 14 04:29:36.851947 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:36.855295 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:36.916282 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:36.974818 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Booting with volume acfa5344-cf79-45e9-a4d8-a0099b8b321a at /dev/vda
May 14 04:29:37.015361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:37.057232 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:37.071382 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.071382 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.071914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.072007 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.072515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.072515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:29:37.085649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:37.125645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:37.165656 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully created port: 28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:37.195334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:37.196351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:37.212922 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:37.215176 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:37.219947 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe61:247e', 'fe80::5812:47ff:fe4c:11ae', 'fe80::fc16:3eff:fe46:5a9a'] 
May 14 04:29:37.220107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:37.220694 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:37.221319 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:37.221319 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating existing volume attachment record: 7412bbed-66bb-47bd-b152-9fb9ba6a1781 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:37.276196 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:37.360144 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732977.3596294, 5dd25918-783f-427b-9af7-0bcbd702089f => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:37.360356 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] VM Started (Lifecycle Event)
May 14 04:29:37.490755 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:37.504089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:37.580633 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Took 7.87 seconds to spawn the instance on the hypervisor.
May 14 04:29:37.580938 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:37.659419 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully created port: d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:37.728579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:37.753461 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:37.755084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:37.755357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:37.755657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:37.755804 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] No waiting events found dispatching network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:37.755992 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-908f60dc-7876-466f-9b06-939ad64def36 req-bd740dfb-73a0-4d65-a58d-e51a77ee643e service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received unexpected event network-vif-plugged-c227d380-e20a-44db-af58-c1bdb1c56860 for instance with vm_state active and task_state None.
May 14 04:29:37.869089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:37.872268 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:37.993064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:37.993300 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'migration_context' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:38.103837 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Took 14.88 seconds to build instance.
May 14 04:29:38.134563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:38.135502 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:38.135747 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Attaching volume e821ab90-ad69-46d1-8cfc-948a6eeae50c to /dev/vdb
May 14 04:29:38.185705 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:38.198833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:38.226816 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:38.272097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:38.272263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:38.283882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:38.285798 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe61:247e', 'fe80::5812:47ff:fe4c:11ae', 'fe80::fc16:3eff:fe46:5a9a'] 
May 14 04:29:38.285949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:38.286117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:38.286698 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:38.288542 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating existing volume attachment record: a9061695-7d7e-4670-9658-2b1d7d2bf0e7 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:38.349967 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: 679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:38.376301 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732978.375899, 5dd25918-783f-427b-9af7-0bcbd702089f => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:38.377145 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] VM Paused (Lifecycle Event)
May 14 04:29:38.427657 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:38.427657 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-679826a3-26c9-405f-a2f3-34d4340134b5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:38.427657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:38.427657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:38.427657 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:38.499163 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Object Instance<3370940d-3bd7-45f3-887f-9c515137a348> lazy-loaded attributes: info_cache,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:38.505441 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:38.505835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:38.609431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:38.612366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.393s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:38.612796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:38.613142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:38.613306 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:38.613464 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:38.617051 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Terminating instance
May 14 04:29:38.879085 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:38.879455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:38.879705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:38.880586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:38.882677 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:38.882962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:38.888359 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732978.8880892, 5dd25918-783f-427b-9af7-0bcbd702089f => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:38.888569 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] VM Resumed (Lifecycle Event)
May 14 04:29:38.900655 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Booting with volume be24eba5-bbd0-423c-a3d1-e85718a1b9d0 at /dev/vdb
May 14 04:29:38.904429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:38.904920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:38.907368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:38.907368 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:38.907756 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:38.907964 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:38.919295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:38.919295 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:38.933390 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:38.938056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:38.938056 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c] added
May 14 04:29:38.946314 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:38.946314 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:38.946314 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c] added
May 14 04:29:38.952639 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:38.952639 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0435(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:38.952639 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:38.979720 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:38.994872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:39.021182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:39.055560 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:39.066560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:39.068299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:39.082721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:39.088533 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe61:247e', 'fe80::5812:47ff:fe4c:11ae', 'fe80::fc16:3eff:fe46:5a9a'] 
May 14 04:29:39.088533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:39.088533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:39.088533 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:39.088533 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating existing volume attachment record: dceb1dfc-6d1e-41d3-aa87-1a79600c1c53 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:39.121808 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:29:39.158539 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.163937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.187047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.363782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.376685 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.391824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:39.435321 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.440264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.458016 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:39.472975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.603088 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99966037199988 future=<Future at 0x7435f8432b70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:39.604770 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Instance destroyed successfully.
May 14 04:29:39.605567 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lazy-loading 'resources' on Instance uuid 5dd25918-783f-427b-9af7-0bcbd702089f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:39.610581 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99181315199985 future=<Future at 0x7435f8432b70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:39.613856 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.991550226000072 future=<Future at 0x7435f8432b70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:39.654467 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.671309 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:39.834076 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99968752299992 future=<Future at 0x7435f84562d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:39.836906 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance destroyed successfully.
May 14 04:29:39.838601 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'numa_topology' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:39.877733 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: 93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:39.946322 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:39.952605 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:39.966518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230a2a2-c0e0-4efb-a93f-d7ef2b43815d req-23ee10f2-7325-4953-a2af-01483591edc7 service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:39.971323 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:39.971323 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:39.978733 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:39.978733 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:39.984144 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:39.984334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:39.984699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:39.984699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:39.985122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] No waiting events found dispatching network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:39.985122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b1fc135a-d066-4f39-a765-feb0d80cee33 req-83cda773-404b-4a48-96ed-c62c35443ebf service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:39.993500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.005389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.013182 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.013452 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.024448 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.024785 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:40.077266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.50.100,3260]
May 14 04:29:40.077266 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.50.100,3260] successful.
May 14 04:29:40.077266 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.091348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.40.100,3260]
May 14 04:29:40.091348 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.40.100,3260] successful.
May 14 04:29:40.091348 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.093766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.107296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:40.116165 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-876234790',display_name='tempest-ServersNegativeTestJSON-server-876234790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-876234790',id=28,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:37Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-6cfm0bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:38Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=5dd25918-783f-427b-9af7-0bcbd702089f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:40.116165 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "c227d380-e20a-44db-af58-c1bdb1c56860", "address": "fa:16:3e:46:5a:9a", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc227d380-e2", "ovs_interfaceid": "c227d380-e20a-44db-af58-c1bdb1c56860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:40.119638 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:40.119638 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.125922 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.126232 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:40.126603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.132087 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:40.132344 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:40.133192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:40.133383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:40.135109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] HCTL ('15', '-', '-', 0) found on session 53 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:40.135109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:40.135595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:40.135903 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc227d380-e2, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:40.157316 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:40.159067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:40.159423 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0c569b2-dee7-48a0-b446-b6f2224ba00f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:40.160985 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:40.176987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] HCTL ('16', '-', '-', 0) found on session 54 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:40.176987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:40.180610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:40.183500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching for a device in session 53 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:40.184551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:40.186464 np0000000747 nova-compute[97971]: INFO os_vif [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:5a:9a,bridge_name='br-int',has_traffic_filtering=True,id=c227d380-e20a-44db-af58-c1bdb1c56860,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc227d380-e2')
May 14 04:29:40.186794 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Deleting instance files /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f_del
May 14 04:29:40.187480 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Deletion of /opt/stack/data/nova/instances/5dd25918-783f-427b-9af7-0bcbd702089f_del complete
May 14 04:29:40.201745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching for a device in session 54 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:40.201873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:40.348349 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attempting rescue
May 14 04:29:40.348501 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:29:40.361779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:29:40.361779 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Creating image(s)
May 14 04:29:40.362258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:40.362855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:40.363336 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:40.363518 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:40.576940 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:40.579607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-93d1a992-d312-47c0-bd27-02005cfdb5f5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:40.579607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:40.579607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:40.579607 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:40.696349 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Took 1.57 seconds to destroy the instance on the hypervisor.
May 14 04:29:40.697179 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:29:40.697537 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:29:40.697686 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:29:40.698161 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:40.717294 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:40.717603 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:40.774774 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:40.821841 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Booting with volume 5e6cf1e8-a1bf-4634-9d5e-b6427a99928c at /dev/vdc
May 14 04:29:40.866785 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:40.871026 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:40.874984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:40.885986 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:40.888152 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:40.896514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:40.898115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:40.899840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:40.901976 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:40.903857 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:40.913772 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:29:40.918328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:40.939705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:40.941109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:40.974598 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:41.045690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.129s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:41.046240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:41.069595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:41.070509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:41.083863 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:41.092286 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:41.099996 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe7a:eabc', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe61:247e', 'fe80::5812:47ff:fe4c:11ae'] 
May 14 04:29:41.100297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:41.103444 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:41.104822 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:41.104822 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating existing volume attachment record: f7c52a31-c6bf-43e0-a83b-ec99816f96e1 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:41.128666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.rescue" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:41.129067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:41.129558 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'migration_context' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:41.223196 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: 96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:41.226289 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:41.255645 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:41.401225 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:29:41.489158 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:41.516737 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:41.517126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:41.517438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:41.517905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:41.517905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:41.520535 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Terminating instance
May 14 04:29:41.635179 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:41.638259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:29:41.638259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start _get_guest_xml network_info=[{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:b8:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:41.638259 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:41.677194 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:41.963608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found WWN 330000000cd525dc4 for multipath device dm-8 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:41.964804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.084s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:41.964804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== connect_volume: return (3085ms) {'type': 'block', 'scsi_wwn': '330000000cd525dc4', 'path': '/dev/dm-8', 'multipath_id': '330000000cd525dc4'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:41.965097 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd525dc4', 'path': '/dev/dm-8', 'multipath_id': '330000000cd525dc4'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:41.975167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:41.977061 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:41.991899 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-34f32c8f-86a6-4045-99a7-278d3be498f2 req-df18f2e0-35de-43be-a004-e28ea6f8b5dc service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:42.026886 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:29:42.070552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.074316 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.103985 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.108939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.132712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:42.132983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Acquiring lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:42.134067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:42.135295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "5dd25918-783f-427b-9af7-0bcbd702089f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:42.135944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] No waiting events found dispatching network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:42.136250 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-unplugged-c227d380-e20a-44db-af58-c1bdb1c56860 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:42.136501 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:42.136998 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:42.138763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:42.139254 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:42.139410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:42.140483 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:42.140806 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state rescuing.
May 14 04:29:42.140998 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:42.141163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:42.141307 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:42.141427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:42.141551 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:42.142326 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state rescuing.
May 14 04:29:42.142703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbddfa38-22e5-453c-9150-a3c22281bad5 req-22970c94-7d0f-4ea5-8d60-8171a41dc947 service nova] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Received event network-vif-deleted-c227d380-e20a-44db-af58-c1bdb1c56860 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:42.148496 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.152721 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:42.152721 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1739446664', uuid='a7b6e4bf-576f-438e-907f-71fef72b19b5'), owner=OwnerMeta(userid='79086847c5a343519481b0a50930103f', username='tempest-ServerRescueNegativeTestJSON-1810790550-project-member', projectid='cfaef82fed39403a80c7ec4baa8ad091', projectname='tempest-ServerRescueNegativeTestJSON-1810790550'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:b8:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732982.1517603) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:42.158468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:42.158900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:42.165063 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:42.165325 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:42.166607 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:42.166992 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:42.167182 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:42.167311 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:42.167508 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:42.167569 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:42.167698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:42.167925 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:42.168118 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:42.168294 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:42.168477 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:42.168569 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:42.168767 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:42.179164 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Took 1.48 seconds to deallocate network for instance.
May 14 04:29:42.240900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.735s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:42.244294 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.267s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:42.248944 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:29:42.249129 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Claim successful on node np0000000747
May 14 04:29:42.370866 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999632139999903 future=<Future at 0x7436186d2120 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:42.375104 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Instance destroyed successfully.
May 14 04:29:42.376524 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lazy-loading 'resources' on Instance uuid 5c1dc166-7639-43d8-8405-2c173c69abaa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:42.451666 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: 071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:42.481265 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Attempting to attach volume e821ab90-ad69-46d1-8cfc-948a6eeae50c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:29:42.482389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:   <alias name="ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c"/>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:   <serial>e821ab90-ad69-46d1-8cfc-948a6eeae50c</serial>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]: </disk>
May 14 04:29:42.482389 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:29:42.655418 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:42.657197 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-96b18678-fcba-44b3-ba6b-adbe5544a062. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:42.659887 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:42.660071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:42.660978 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:42.672030 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:42.695978 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1739446664',display_name='tempest-ServerRescueNegativeTestJSON-server-1739446664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1739446664',id=23,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYqv3s463mDZiZNCMV6O57fhNxf2RO2CpxEBkvzL2dkobV1k8FqQgv/RWk0eox7we2ogr+KSmSOxKTRWXSY5Gq3EDTpU7HagD6Mla6dAXMddfk7ZilmxO0oQoGK7Yo5w==',key_name='tempest-keypair-1249813357',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:44Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-0uhmj886',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79086847c5a343519481b0a50930103f',uuid=a7b6e4bf-576f-438e-907f-71fef72b19b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:b8:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:42.695978 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "vif_mac": "fa:16:3e:9c:b8:5b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:42.696769 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:42.697470 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'pci_devices' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:42.700011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:42.880248 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410559882',display_name='tempest-VolumesActionsTest-instance-1410559882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesactionstest-instance-1410559882',id=27,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b35a824e8e9c463dba8bc365f617dc3a',ramdisk_id='',reservation_id='r-5h2bdx0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-657133820',owner_user_name='tempest-VolumesActionsTest-657133820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:35Z,user_data=None,user_id='ee1ac8dfdafb41e8970f194512d19939',uuid=5c1dc166-7639-43d8-8405-2c173c69abaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:42.880441 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converting VIF {"id": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "address": "fa:16:3e:61:24:7e", "network": {"id": "4720d8b5-be14-4964-8aa7-8b21af7b13b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1031133968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b35a824e8e9c463dba8bc365f617dc3a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e6deb4-f0", "ovs_interfaceid": "b9e6deb4-f0c6-4606-937a-0708ccb3d207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:42.881111 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:42.881441 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:42.886673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.886958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9e6deb4-f0, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:42.891581 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.896473 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:42.896473 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.897346 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.897532 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed5e8267-c5f7-4f0d-abf1-936682313b34) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:42.898153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.898878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:42.901123 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocation for migration 7420c58e-fdbb-459e-8e83-32f90ce17c07
May 14 04:29:42.904504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:42.907711 np0000000747 nova-compute[97971]: INFO os_vif [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:24:7e,bridge_name='br-int',has_traffic_filtering=True,id=b9e6deb4-f0c6-4606-937a-0708ccb3d207,network=Network(4720d8b5-be14-4964-8aa7-8b21af7b13b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e6deb4-f0')
May 14 04:29:42.908076 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Deleting instance files /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa_del
May 14 04:29:42.908714 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Deletion of /opt/stack/data/nova/instances/5c1dc166-7639-43d8-8405-2c173c69abaa_del complete
May 14 04:29:43.163593 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:43.204504 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:43.204504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <uuid>a7b6e4bf-576f-438e-907f-71fef72b19b5</uuid>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <name>instance-00000017</name>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1739446664</nova:name>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:42</nova:creationTime>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:user uuid="79086847c5a343519481b0a50930103f">tempest-ServerRescueNegativeTestJSON-1810790550-project-member</nova:user>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:project uuid="cfaef82fed39403a80c7ec4baa8ad091">tempest-ServerRescueNegativeTestJSON-1810790550</nova:project>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         <nova:port uuid="e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="serial">a7b6e4bf-576f-438e-907f-71fef72b19b5</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="uuid">a7b6e4bf-576f-438e-907f-71fef72b19b5</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.rescue"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config.rescue"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:b8:5b"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <target dev="tape3bbd018-f0"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/console.log" append="off"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:43.204504 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:43.208065 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance destroyed successfully.
May 14 04:29:43.276711 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:43.277854 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:43.278178 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Creating image(s)
May 14 04:29:43.278557 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:29:43.280391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Ensure instance console log exists: /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:43.280391 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:43.280767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:43.280767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:43.407521 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b82dfec2-a7ae-45e6-9008-cff36afb2022 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.498s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:43.421508 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 04:29:43.425100 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:29:43.425563 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:29:43.425787 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:29:43.425970 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:43.527685 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:43.577410 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:43.778238 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:44.086106 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:44.128992 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:44.129213 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing instance network info cache due to event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:44.129409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:44.129550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:44.129737 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:44.162797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.162797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.162797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.162797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No VIF found with MAC fa:16:3e:25:43:ad, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:44.235530 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:44.237123 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-071b8798-7c20-4bc2-9085-1189c5639d06. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:44.237123 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:44.438115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:44.438397 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:44.447076 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:44.589925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:44.590079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:44.590278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:44.590399 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:44.590527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:44.590654 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] No waiting events found dispatching network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:44.591167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:44.591387 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:44.591650 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:44.593037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:44.593186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Acquiring lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:44.593317 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:44.593409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:44.593526 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] No waiting events found dispatching network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:44.593646 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-960ad4d7-2906-41b7-b512-c6e0ed229ee5 req-334e3036-17ee-4aed-b805-1f036f36f30f service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-unplugged-b9e6deb4-f0c6-4606-937a-0708ccb3d207 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:44.632152 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:44.666667 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: 28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:44.728526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.728704 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.728860 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:29:44.729139 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] No VIF found with MAC fa:16:3e:9c:b8:5b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:29:44.729556 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Using config drive
May 14 04:29:44.941577 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:44.951579 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Took 1.53 seconds to deallocate network for instance.
May 14 04:29:44.979948 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:45.094912 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:45.144150 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updated VIF entry in instance network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:45.144447 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:45.205866 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:45.235941 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'ec2_ids' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:45.410093 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:45.451572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.210s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:45.452541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.752s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:45.452541 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:29:45.460093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:45.648638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8094da13-f382-4440-af2d-e8e0ba2c4cee req-599106d0-3d80-48c2-a350-0ff8ec643b2c service nova] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:45.733247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4bc34863-9b3d-4c1d-8432-7fb214e24a6f tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.597s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:45.740027 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:45.740249 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'keypairs' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:45.792143 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Successfully updated port: d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:45.870319 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:45.912021 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:45.912220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:45.912327 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-ce04dea8-56f7-46d5-9f5c-3b3691f4c554. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:45.912496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:45.912649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:45.912719 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:45.967659 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:29:45.968876 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:29:45.968876 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:45.969096 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:46.063311 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b73f8491edc4c59b345fbd4d3b6c6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3030a0d75e9c41828981f529272fd47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:29:46.212860 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:46.219122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing instance network info cache due to event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:46.219410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:46.219576 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:46.219784 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:46.251461 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:46.252197 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:46.295496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:46.414987 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:46.429847 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Creating config drive at /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config.rescue
May 14 04:29:46.437019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8lqjdzci {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:46.473386 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:29:46.491299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8lqjdzci" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:29:46.598526 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:46.617036 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:46.617394 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:46.718638 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Successfully created port: 7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:29:46.727640 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:46.811344 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:46.987115 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:29:47.046588 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.075835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.082291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.122434 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:47.175096 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:47.189748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.227034 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.319133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:47.319603 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Received event network-vif-deleted-b9e6deb4-f0c6-4606-937a-0708ccb3d207 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:47.319733 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Neutron deleted interface b9e6deb4-f0c6-4606-937a-0708ccb3d207; detaching it from the instance and deleting it from the info cache
May 14 04:29:47.319941 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:47.321136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:47.321349 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:47.375504 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updated VIF entry in instance network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:47.375774 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:47.423157 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:47.423412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:47.424670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:47.427151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:47.427151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:47.427440 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dc6aa6bb-2a7f-4102-b87c-bf3e28b09362 req-99d64fce-4592-4337-82f5-a670a0baf09f service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state rescuing.
May 14 04:29:47.491661 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Booting with blank volume at /dev/vda
May 14 04:29:47.639669 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.188s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:47.641702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.181s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:47.730429 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Deleted allocations for instance 5dd25918-783f-427b-9af7-0bcbd702089f
May 14 04:29:47.780194 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Successfully updated port: 7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:29:47.827351 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b50dae67-e277-4568-a2d6-97f7d1af27b2 req-b4a39a91-ec38-4358-8344-ca901d489a97 service nova] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Detach interface failed, port_id=b9e6deb4-f0c6-4606-937a-0708ccb3d207, reason: Instance 5c1dc166-7639-43d8-8405-2c173c69abaa could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:29:47.880290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:47.880290 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:47.880485 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-28dc8cbf-1b8d-4085-9933-374f3afb1375. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:47.880561 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:47.899756 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:47.996512 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:48.054868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:48.055262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:48.056977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:48.056977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:48.058527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:48.062565 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Terminating instance
May 14 04:29:48.201571 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for a7b6e4bf-576f-438e-907f-71fef72b19b5 due to new event <LifecycleEvent: 1778732988.199889, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:29:48.201571 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732988.199889, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:48.201571 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Resumed (Lifecycle Event)
May 14 04:29:48.214519 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-69aca78d-cdb3-4840-8a50-35700c745951 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:48.268258 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:48.283299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:48.283299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:48.283299 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:48.570213 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:29:48.611660 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:48.631726 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:48.681453 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:48.709749 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:48.714790 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:48.744428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-75346047-127e-4bf6-8cae-e2c1ee7cb44e tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "5dd25918-783f-427b-9af7-0bcbd702089f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.132s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:48.787587 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:48.797444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:48.890887 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:48.890887 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:48.919193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:48.919299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:48.922505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:48.922505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:48.922505 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:48.922505 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2ca29a64-c6fd-44c7-9ce3-c1606cbdd4ea req-33a764d2-9f3e-4551-a38e-3e1f822bf144 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:48.938528 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Instance destroyed successfully.
May 14 04:29:48.939260 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'resources' on Instance uuid ec7eb127-aa14-4632-aadd-d50696b45625 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:48.963200 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:29:49.217863 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732989.2175019, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:49.218035 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Started (Lifecycle Event)
May 14 04:29:49.250834 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:49.256406 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:49.395337 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:49.445737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1210740464',display_name='tempest-ServerActionsTestOtherA-server-1210740464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-1210740464',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:09Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-mkrnguwu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=ec7eb127-aa14-4632-aadd-d50696b45625,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:49.446055 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "address": "fa:16:3e:7a:ea:bc", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7a5f1d8-89", "ovs_interfaceid": "d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:49.446976 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:49.447334 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:49.456562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:49.457128 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7a5f1d8-89, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:49.460486 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:49.463941 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:49.465291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:49.465503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8133ee68-6600-49fd-86dc-492f7942626a) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:49.466146 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:49.467293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:49.472297 np0000000747 nova-compute[97971]: INFO os_vif [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7a5f1d8-89')
May 14 04:29:49.474804 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:29:49.475274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:49.475413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:49.476065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:49.476217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90ebb94c-0b74-48de-ba06-6488816ef98b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:29:49.476421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:29:49.497896 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:49.525505 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:49.526287 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '54')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:29:49.526287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '49')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:29:49.527975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b', '50')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:29:49.530167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f847b380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:29:49.530362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:29:49.530832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Flush multipath device 330000000a6571e3c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:29:49.572276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-changed-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:49.574377 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Refreshing instance network info cache due to event network-changed-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:49.574377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Acquiring lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:49.578948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:29:49.628739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:29:49.686970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:29:49.687283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:29:49.689265 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:29:49.698021 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:49.706798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:29:49.707296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:29:49.723307 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:49.726896 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.731179 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:49.774330 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260]
May 14 04:29:49.774330 np0000000747 nova-compute[97971]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.40.100,3260] successful.
May 14 04:29:49.774330 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.798647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.817754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.853828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260]
May 14 04:29:49.853828 np0000000747 nova-compute[97971]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-90ebb94c-0b74-48de-ba06-6488816ef98b, portal: 192.168.50.100,3260] successful.
May 14 04:29:49.853828 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.872769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:49.873042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:49.873182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] <== disconnect_volume: return (397ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:49.873332 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:29:49.874119 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Deleting instance files /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625_del
May 14 04:29:49.874817 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Deletion of /opt/stack/data/nova/instances/ec7eb127-aa14-4632-aadd-d50696b45625_del complete
May 14 04:29:49.905117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.264s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:49.983805 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Deleted allocations for instance 5c1dc166-7639-43d8-8405-2c173c69abaa
May 14 04:29:50.008485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:50.009392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance network_info: |[{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:50.009392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Acquired lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:50.009392 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Refreshing network info cache for port 7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:50.035975 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.092001 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Unrescuing
May 14 04:29:50.092196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:50.092323 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:50.092485 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:29:50.234650 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 04:29:50.234963 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999834874000044 future=<Future at 0x7435f8384e60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:50.351858 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.382600 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Took 1.81 seconds to destroy the instance on the hypervisor.
May 14 04:29:50.386069 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:29:50.386733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:29:50.387041 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:29:50.387298 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.469861 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.511557 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.594520 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.770637 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:50.874320 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:51.008764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3a51e7f9-5c63-4628-bd40-70c506892fde tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Lock "5c1dc166-7639-43d8-8405-2c173c69abaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.492s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:51.019730 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:51.052356 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:51.060164 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:51.073058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:29:51.097868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:29:51.100194 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:51.100371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] Acquiring lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:51.100583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:51.100982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] Lock "ec7eb127-aa14-4632-aadd-d50696b45625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:51.101100 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] No waiting events found dispatching network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:51.101228 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3936e114-d34c-4e14-889e-b4dccf84828b req-516a6f29-0a1c-451f-8394-37d9e8cdce70 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-unplugged-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:51.152078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:29:51.152492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:29:51.168346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:29:51.170309 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fedd:d4ea', 'fe80::4cb8:87ff:fe80:f45b', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fe25:43ad', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fec8:403c', 'fe80::1839:beff:fecd:bfd0', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe9c:b85b'] 
May 14 04:29:51.170591 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:29:51.170782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:29:51.171075 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:51.171340 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating existing volume attachment record: 1866bd55-0cf8-447e-9e20-dc7bb25f0289 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:29:51.204660 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:51.276943 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updated VIF entry in instance network info cache for port 7ed5d49e-dce2-42e3-8dbc-7b130844d6d1. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:51.276943 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:51.408320 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:51.448920 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:51.524967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:51.529724 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance network_info: |[{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:29:51.529724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:51.530050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Start _get_guest_xml network_info=[{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7412bbed-66bb-47bd-b152-9fb9ba6a1781', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949', 'attached_at': '', 'detached_at': '', 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'serial': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a'}, 'volume_type': None}, {'attachment_id': 'dceb1dfc-6d1e-41d3-aa87-1a79600c1c53', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949', 'attached_at': '', 'detached_at': '', 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'serial': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0'}, 'volume_type': None}, {'attachment_id': 'f7c52a31-c6bf-43e0-a83b-ec99816f96e1', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949', 'attached_at': '', 'detached_at': '', 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'serial': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:51.530050 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:51.532037 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:51.533719 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-569458513', uuid='26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'), owner=OwnerMeta(userid='640e693a251443fdb4b297994247b01b', username='tempest-TaggedBootDevicesTest_v242-2056355007-project-member', projectid='434cba1835e7445d88c5e06f8000f80b', projectname='tempest-TaggedBootDevicesTest_v242-2056355007'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732991.5331242) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:51.535726 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:51.536217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:51.537544 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:51.537837 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:51.538983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:51.539448 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:51.539608 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:51.539921 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:51.540093 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:51.540227 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:51.540442 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:51.540707 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:51.541282 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:51.541779 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:51.541932 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:51.542073 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:51.554047 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:51.554444 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:51.554600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:51.555258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:51.555653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:51.568277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:51.569959 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:51.570515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:51.570740 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:51.571137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:51.571588 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:51.583266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:51.583266 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:51.589078 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:51.589078 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:51.596583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a] added
May 14 04:29:51.596583 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:51.596583 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:51.596583 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:51.596583 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:51.596583 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:51.596583 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:51.597384 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:51.597384 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:51.597384 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:51.601915 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a] added
May 14 04:29:51.601915 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:51.601915 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:51.601915 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:51.601915 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:51.601915 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:51.601915 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:51.602195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:51.602286 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:51.602455 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Releasing lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:51.780674 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-270ec9d4-93fb-4d86-b114-f861ae5ec5f7 req-e8c60ffd-1870-41d4-93bf-6760e0d496e0 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state rescued and task_state None.
May 14 04:29:51.911042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:51.911776 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'flavor' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:51.951228 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Took 1.56 seconds to deallocate network for instance.
May 14 04:29:52.031456 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:52.451209 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:52.459873 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:52.469521 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:52.480263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:52.534326 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Took 0.58 seconds to detach 1 volumes for instance.
May 14 04:29:52.540036 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Deleting volume: 90ebb94c-0b74-48de-ba06-6488816ef98b {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:29:52.597986 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:52.603686 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:52.615230 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:52.615230 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:52.622560 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:52.622560 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.641886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.645997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.648389 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.671001 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.671307 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.675788 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:52.724008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.40.100,3260]
May 14 04:29:52.724008 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.40.100,3260] successful.
May 14 04:29:52.724008 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.728669 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updated VIF entry in instance network info cache for port 28dc8cbf-1b8d-4085-9933-374f3afb1375. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:52.730079 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:52.741299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.50.100,3260]
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.50.100,3260] successful.
May 14 04:29:52.786565 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.786565 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('7', '-', '-', 0) found on session 55 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:52.786565 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d64edf6e-cdf2-4497-847f-f2618254d4b6 req-e8bb83b4-c58c-4d83-9fbc-59fd54362f6b service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state rescued and task_state unrescuing.
May 14 04:29:52.787722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:52.802886 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999704263000012 future=<Future at 0x7436183b7410 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:52.806292 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance destroyed successfully.
May 14 04:29:52.806292 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'numa_topology' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:52.807089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 55 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:52.808394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.813402 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:52.813820 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:52.814172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.243s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:52.814172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:52.817841 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('8', '-', '-', 0) found on session 56 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:52.818423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:52.837194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 56 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:52.837411 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:53.098348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:53.099044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:53.117583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:53.117901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:53.172165 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-954ecd5c-bc2a-41e4-95eb-d7af61d803a7 req-7850825e-888d-4b4e-9b3a-7b578c55bd92 service nova] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Received event network-vif-deleted-d7a5f1d8-8944-4089-b5fd-7eb0f92fde1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:53.231730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:53.231913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:53.232060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-d2dcc064-5740-4e0a-a1b5-21d988064509. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:53.232294 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:53.232419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:53.232524 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:53.262585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:53.306032 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:29:53.307105 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:29:53.307335 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Creating image(s)
May 14 04:29:53.307673 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:29:53.307813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Ensure instance console log exists: /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:29:53.308094 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:53.308156 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:53.308279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:53.308848 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start _get_guest_xml network_info=[{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1866bd55-0cf8-447e-9e20-dc7bb25f0289', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5faa3a7e-8ade-4e0b-9568-465fc7c61dcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'serial': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:29:53.309758 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Object Instance<a7b6e4bf-576f-438e-907f-71fef72b19b5> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:29:53.313262 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:29:53.314711 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014', uuid='5faa3a7e-8ade-4e0b-9568-465fc7c61dcc'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778732993.314317) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:29:53.326147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:29:53.326485 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:29:53.328921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:29:53.329116 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:29:53.329888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:29:53.330420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:29:53.330420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:29:53.330420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:29:53.330669 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:29:53.330669 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:29:53.330669 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:29:53.330798 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:29:53.330885 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:29:53.330992 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:29:53.331096 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:29:53.331199 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:29:53.344767 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:53.345043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:53.345180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:53.571830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:53.623547 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Detaching volume e821ab90-ad69-46d1-8cfc-948a6eeae50c
May 14 04:29:53.676195 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Attempting to driver detach volume e821ab90-ad69-46d1-8cfc-948a6eeae50c from mountpoint /dev/vdb
May 14 04:29:53.686655 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found disk vdb by alias ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:29:53.687891 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found disk vdb by alias ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:29:53.688034 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Attempting to detach device vdb from instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:29:53.688307 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <alias name="ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c"/>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <serial>e821ab90-ad69-46d1-8cfc-948a6eeae50c</serial>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]: </disk>
May 14 04:29:53.688307 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:29:53.697376 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully detached device vdb from instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 from the persistent domain config.
May 14 04:29:53.697525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] (1/8): Attempting to detach device vdb with device alias ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c from instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:29:53.697842 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <alias name="ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c"/>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-8"/>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <serial>e821ab90-ad69-46d1-8cfc-948a6eeae50c</serial>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]: </disk>
May 14 04:29:53.697842 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:29:53.737715 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:53.810005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.853122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.855557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.947743 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.984073 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.987127 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:53.989335 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:29:53.989693 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:29:54.144118 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:54.278734 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778732994.2783573, c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 => ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:29:54.280548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e821ab90-ad69-46d1-8cfc-948a6eeae50c for instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:29:54.286035 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully detached device vdb from instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 from the live domain config.
May 14 04:29:54.289948 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:29:54.290550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:54.290813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:54.296161 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updated VIF entry in instance network info cache for port d2dcc064-5740-4e0a-a1b5-21d988064509. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:54.296941 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:54.466883 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:54.493211 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:29:54.589441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Found WWN 3300000006d1a4580 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:54.589441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:54.589441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000006d1a4580', 'path': '/dev/dm-0', 'multipath_id': '3300000006d1a4580'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:54.589708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d1a4580', 'path': '/dev/dm-0', 'multipath_id': '3300000006d1a4580'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:54.590096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.245s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:54.590371 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:54.603007 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.001122176000080799 future=<Future at 0x7435f8432b70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.603290 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.603422 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.23031474000003982 future=<Future at 0x7435f84562d0 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.603845 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-eb89b371-589e-424e-836f-6667af42560b None None] Emitting event <LifecycleEvent: 1778732979.6016643, 5dd25918-783f-427b-9af7-0bcbd702089f => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:54.604219 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.2295354899999893 future=<Future at 0x7435f84562d0 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.604500 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] VM Stopped (Lifecycle Event)
May 14 04:29:54.606147 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.606248 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.7641909700000724 future=<Future at 0x7436186d2120 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.606326 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.7641042200000356 future=<Future at 0x7436186d2120 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:54.606799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:54.607942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:54.609520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:54.609881 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:54.610772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:54.611088 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:54.622101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:54.622101 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:54.627816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:54.627816 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:54.636487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494] added
May 14 04:29:54.636487 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:54.636487 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:54.636487 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:54.636487 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:54.636487 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:54.636487 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:54.636798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:54.637644 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:54.637644 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:54.639717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494] added
May 14 04:29:54.639717 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:54.639717 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:54.639717 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:54.639717 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:54.639717 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:54.639717 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:54.639872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:54.640105 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:54.640285 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:54.673601 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for a7b6e4bf-576f-438e-907f-71fef72b19b5 due to new event <LifecycleEvent: 1778732994.6733005, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:29:54.673812 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732994.6733005, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:54.673886 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Resumed (Lifecycle Event)
May 14 04:29:54.675254 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-244bec8f-75ef-4ba3-a6a2-cd0657a31bbe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:54.799253 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b6c8adf6-4c5f-4cf4-b334-736f39200e1e req-d29250f8-2867-4653-a38b-d737cf0a2f5a service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:54.867204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:54.867408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:54.867593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:54.867783 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:54.867959 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:54.868340 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state None.
May 14 04:29:54.868504 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:54.868713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:54.868886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:54.869017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:54.869167 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:54.869321 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state None.
May 14 04:29:54.869469 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:54.869666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:54.869839 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:54.869984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:54.870174 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:54.870337 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8048a7d1-c960-447c-a23d-49d28206c7ec req-a104a920-f9a5-42e4-b453-c683e66f2ac3 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-plugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state active and task_state None.
May 14 04:29:55.001053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.902s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:55.058284 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Deleted allocations for instance ec7eb127-aa14-4632-aadd-d50696b45625
May 14 04:29:55.094060 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:29:55.094324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:29:55.094468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:55.111544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 5dd25918-783f-427b-9af7-0bcbd702089f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:55.176373 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:55.178285 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:55.637745 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:55.640786 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:55.652310 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:55.652310 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:55.659098 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:55.659098 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.668342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.678184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.685180 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778732995.6847687, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:55.685330 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Started (Lifecycle Event)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.694914 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.699946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.700378 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:55.750526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.40.100,3260]
May 14 04:29:55.750526 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.40.100,3260] successful.
May 14 04:29:55.750526 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.757481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.50.100,3260]
May 14 04:29:55.757481 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.50.100,3260] successful.
May 14 04:29:55.757481 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.764000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.772410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.791089 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('17', '-', '-', 0) found on session 57 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:55.791089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:55.799771 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('18', '-', '-', 0) found on session 58 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:55.799771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:55.812448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 57 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:55.812448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:55.836556 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 58 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:55.837186 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:55.875781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:55.926037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:55.926519 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing instance network info cache due to event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:55.926787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:55.926952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:55.927117 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:56.071320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b48745a8-4509-432b-a81a-50e1dd60c004 tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "ec7eb127-aa14-4632-aadd-d50696b45625" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.015s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:56.188166 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:56.190254 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:29:56.336701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:56.336975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:56.337160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:56.337262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:56.337409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:56.339834 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Terminating instance
May 14 04:29:56.433251 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:56.610404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:29:56.747104 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:56.843023 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:29:56.876458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:56.877569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:56.907681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:56.910825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:56.924248 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updated VIF entry in instance network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:56.924504 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:56.936842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:56.937816 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.067058 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:57.067531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:57.067838 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:57.068020 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:57.068192 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] No waiting events found dispatching network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:57.068366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5edcff3f-5055-4392-a3f6-8bb89732e8e4 req-2b298d09-803a-4b96-ade4-39e6c51ee238 service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:57.157531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.170727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.188432 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99975485699997 future=<Future at 0x7435f844c590 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:57.190114 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Instance destroyed successfully.
May 14 04:29:57.190662 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lazy-loading 'resources' on Instance uuid 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:57.371316 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0008334280000781291 future=<Future at 0x7436186d2120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:57.371433 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:57.371546 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.863257586000145 future=<Future at 0x7435f8384e60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:57.371715 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.863072613999975 future=<Future at 0x7435f8384e60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:57.372401 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] Emitting event <LifecycleEvent: 1778732982.3703728, 5c1dc166-7639-43d8-8405-2c173c69abaa => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:29:57.372521 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] VM Stopped (Lifecycle Event)
May 14 04:29:57.426363 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7591e652-e6ea-4fa2-a3db-3ca5b9eaac89 req-d4ac950c-7bdf-446b-85b3-fe5ef8256d96 service nova] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:57.626820 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Found WWN 3300000008e2a4ac0 for multipath device dm-11 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:29:57.627122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:57.627280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== connect_volume: return (4281ms) {'type': 'block', 'scsi_wwn': '3300000008e2a4ac0', 'path': '/dev/dm-11', 'multipath_id': '3300000008e2a4ac0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:57.628172 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e2a4ac0', 'path': '/dev/dm-11', 'multipath_id': '3300000008e2a4ac0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:29:57.628172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.337s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:57.628291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:29:57.628430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:57.659598 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:57.660070 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:57.660451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:29:57.660676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '54')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:29:57.661822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', '53')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:29:57.662695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184befc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:29:57.662955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:29:57.663193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flush multipath device 330000000cd525dc4 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:29:57.694368 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-381301142',display_name='tempest-ServersNegativeTestJSON-server-381301142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serversnegativetestjson-server-381301142',id=25,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:20Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cb35548693e4088a0b1c42ad4cc414a',ramdisk_id='',reservation_id='r-ny6cd0i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1703914415',owner_user_name='tempest-ServersNegativeTestJSON-1703914415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:20Z,user_data=None,user_id='9162ff1a39944890abe678ecdc379e27',uuid=3efd7e68-1f22-4e3a-b47a-137c24a1fe8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:57.694640 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converting VIF {"id": "862182a1-bd43-4b5d-86d0-b817eb29999f", "address": "fa:16:3e:c8:40:3c", "network": {"id": "61e1622c-765d-45aa-8f42-4ec0fd07136f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-360671315-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0cb35548693e4088a0b1c42ad4cc414a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap862182a1-bd", "ovs_interfaceid": "862182a1-bd43-4b5d-86d0-b817eb29999f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:57.695715 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:57.696036 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:57.697739 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.698050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap862182a1-bd, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:57.699539 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.700549 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:57.700887 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.702746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.702943 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddc22dd4-9503-4369-a34a-966d2fa55424) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:57.703471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.704146 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:57.704315 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:57.706846 np0000000747 nova-compute[97971]: INFO os_vif [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=862182a1-bd43-4b5d-86d0-b817eb29999f,network=Network(61e1622c-765d-45aa-8f42-4ec0fd07136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap862182a1-bd')
May 14 04:29:57.706846 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Deleting instance files /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b_del
May 14 04:29:57.707552 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Deletion of /opt/stack/data/nova/instances/3efd7e68-1f22-4e3a-b47a-137c24a1fe8b_del complete
May 14 04:29:57.727342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:29:57.775693 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:29:57.833219 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:29:57.833460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:29:57.835570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:29:57.849499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:29:57.849799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:29:57.862101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.863963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:57.864140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:57.864234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:57.864385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:57.864503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:57.867346 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Terminating instance
May 14 04:29:57.876642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-278ade22-e3ab-4fc7-954c-c629827bcd88 tempest-VolumesActionsTest-657133820 tempest-VolumesActionsTest-657133820-project-member] [instance: 5c1dc166-7639-43d8-8405-2c173c69abaa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:29:57.903942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.40.100,3260]
May 14 04:29:57.903942 np0000000747 nova-compute[97971]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.40.100,3260] successful.
May 14 04:29:57.903942 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.927187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.940359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.974023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.50.100,3260]
May 14 04:29:57.974023 np0000000747 nova-compute[97971]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, portal: 192.168.50.100,3260] successful.
May 14 04:29:57.974023 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.994532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:57.994719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:57.994889 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== disconnect_volume: return (3704ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:29:57.995013 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:29:57.998839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.904s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:57.999071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:29:58.015891 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:58.017178 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:29:58.017796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:58.018035 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:58.019396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:29:58.019396 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:58.021748 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:58.022996 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing instance network info cache due to event network-changed-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:29:58.023219 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] Acquiring lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:29:58.023444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] Acquired lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:29:58.023583 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Refreshing network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:29:58.038094 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:58.038094 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:58.050297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:29:58.050297 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:58.056762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0] added
May 14 04:29:58.056762 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:58.056762 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:58.056762 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:58.056762 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:58.056762 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:58.056762 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:58.057209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:58.057628 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:58.057628 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0] added
May 14 04:29:58.065092 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:29:58.065092 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0455(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:29:58.065092 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:29:58.133757 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1799627014',id=30,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-ofsjtxma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:47Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=5faa3a7e-8ade-4e0b-9568-465fc7c61dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:29:58.134032 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:58.134631 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:58.135262 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:58.216438 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 04:29:58.217091 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:29:58.217273 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:29:58.217354 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:29:58.217554 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:58.274189 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:58.370283 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:29:58.393692 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.397601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.420740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.426843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.454994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.528706 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:58.597580 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:58.641788 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] End _get_guest_xml xml=<domain type="qemu">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <uuid>5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</uuid>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <name>instance-0000001e</name>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1799627014</nova:name>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:53</nova:creationTime>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         <nova:port uuid="7ed5d49e-dce2-42e3-8dbc-7b130844d6d1">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <system>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="serial">5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="uuid">5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </system>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <os>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </os>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <features>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </features>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   <devices>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <alias name="ua-e6f5a8a9-da9a-4850-af03-e9b361fdd494"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-11"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <serial>e6f5a8a9-da9a-4850-af03-e9b361fdd494</serial>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </disk>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:c9:19:d4"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <target dev="tap7ed5d49e-dc"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </interface>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/console.log" append="off"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </serial>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <video>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </video>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </rng>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:   </devices>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]: </domain>
May 14 04:29:58.641788 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:29:58.641788 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Preparing to wait for external event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:29:58.641788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:58.641788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:58.647973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:58.647973 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1799627014',id=30,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-ofsjtxma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:47Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=5faa3a7e-8ade-4e0b-9568-465fc7c61dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:29:58.647973 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:58.647973 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:58.647973 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:29:58.649859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.649859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:58.649859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:29:58.654007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.654896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f10ae2e9-1453-5c87-953f-d17330ef70c7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:58.659917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:58.668920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.672917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.673187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ed5d49e-dc, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:58.673717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ed5d49e-dc, col_values=(('qos', UUID('82528455-50c4-4abe-97cf-0332d83d83b7')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:58.673961 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ed5d49e-dc, col_values=(('external_ids', {'iface-id': '7ed5d49e-dce2-42e3-8dbc-7b130844d6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:19:d4', 'vm-uuid': '5faa3a7e-8ade-4e0b-9568-465fc7c61dcc'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:58.679717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:58.689086 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:58.689673 np0000000747 nova-compute[97971]: INFO os_vif [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc')
May 14 04:29:58.739667 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99975718099995 future=<Future at 0x7436186d2420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:29:58.741022 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Instance destroyed successfully.
May 14 04:29:58.741777 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lazy-loading 'resources' on Instance uuid fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:29:58.998827 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:59.058130 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:29:59.065811 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:59.078399 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:59.078399 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:29:59.087555 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:29:59.087555 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.095962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.107642 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.115033 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.115345 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:59.121975 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.134094 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.134542 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:59.174207 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:29:59.177153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] Acquiring lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:59.178542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:59.179404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:59.180498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] No waiting events found dispatching network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:29:59.180729 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9480fa90-ce90-4feb-93f0-e222aea91279 req-b6da8f1c-a68b-47ff-a489-9dbfa4a16dae service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-unplugged-862182a1-bd43-4b5d-86d0-b817eb29999f for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:29:59.182818 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updated VIF entry in instance network info cache for port e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:29:59.183134 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [{"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:29:59.185095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.50.100,3260]
May 14 04:29:59.185095 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.50.100,3260] successful.
May 14 04:29:59.185095 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.197358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.40.100,3260]
May 14 04:29:59.197358 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.40.100,3260] successful.
May 14 04:29:59.197358 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.207005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.216735 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.232648 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.233131 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:59.233490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:59.233490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:59.234921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('15', '-', '-', 0) found on session 59 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:59.235134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.240339 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:29:59.240891 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:29:59.241261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:29:59.241261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:29:59.244715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('16', '-', '-', 0) found on session 60 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:29:59.244715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:29:59.247718 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-891169852',display_name='tempest-ServerActionsTestOtherA-server-891169852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionstestothera-server-891169852',id=2,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAv6sbQ9dVmExtSnby9gyCH1AkM50bTNsd/nGNNzmZvxxt+UfcUyVsvGIXFdYKQwJrhOxIcFTBEpXnhXoAJUIvZwSvywpPIOE6Z1ZZ42rqiT5us2ZGkfOf+99DJw+kOsQ==',key_name='tempest-keypair-614602003',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:25:02Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6680b6e8f4e4852b7d9bb1f67e84fe6',ramdisk_id='',reservation_id='r-bfn00h5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166153365',owner_user_name='tempest-ServerActionsTestOtherA-1166153365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8ede1ead104b17957a4b8b20b80d6b',uuid=fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:29:59.248100 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converting VIF {"id": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "address": "fa:16:3e:dd:d4:ea", "network": {"id": "813f5e72-545e-449f-ad76-5e83a36f770d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1924658592-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c6680b6e8f4e4852b7d9bb1f67e84fe6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc91f949-09", "ovs_interfaceid": "cc91f949-0929-4282-a5c9-6ae4147a7c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:29:59.248816 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:29:59.249148 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:29:59.250544 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:59.250787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc91f949-09, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:59.253291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4344be96-52de-47c4-b5b0-ac656d8ae328) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 60 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 59 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:29:59.267459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:29:59.274817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:29:59.279392 np0000000747 nova-compute[97971]: INFO os_vif [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d4:ea,bridge_name='br-int',has_traffic_filtering=True,id=cc91f949-0929-4282-a5c9-6ae4147a7c9e,network=Network(813f5e72-545e-449f-ad76-5e83a36f770d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc91f949-09')
May 14 04:29:59.279756 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Deleting instance files /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa_del
May 14 04:29:59.280587 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Deletion of /opt/stack/data/nova/instances/fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa_del complete
May 14 04:29:59.609209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6963cb11-331f-42e9-bf19-f71515f69c35 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.491s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:59.611825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 6.347s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:59.612077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:29:59.613019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:29:59.613019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:29:59.616060 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Terminating instance
May 14 04:29:59.626811 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Took 1.41 seconds to deallocate network for instance.
May 14 04:29:59.686422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-173faffb-6927-401e-93bc-d3bbfef65ff8 req-f2896057-1253-4e88-9844-8055b5f42056 service nova] Releasing lock "refresh_cache-a7b6e4bf-576f-438e-907f-71fef72b19b5" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:29:59.788803 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Took 1.42 seconds to destroy the instance on the hypervisor.
May 14 04:29:59.789483 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:29:59.789745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:29:59.789858 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:29:59.790119 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:29:59.880323 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:00.019385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:30:00.117986 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Received event network-vif-deleted-862182a1-bd43-4b5d-86d0-b817eb29999f {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:00.120962 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] No waiting events found dispatching network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:00.122639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:00.123047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Acquiring lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:00.123047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:00.123293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:00.123361 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] No waiting events found dispatching network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:00.123486 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2744ea92-86da-45b8-9813-6fdc1890b89b req-4a76f5ae-d145-4115-9b7d-1033a357e14a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-unplugged-cc91f949-0929-4282-a5c9-6ae4147a7c9e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:00.138878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:00.140921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:00.173929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.180035 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.200792 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.204400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.220044 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:00.220220 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:00.220368 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:c9:19:d4, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:00.220908 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Using config drive
May 14 04:30:00.245458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.468518 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999720414000194 future=<Future at 0x7435f82f45c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:00.471551 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Instance destroyed successfully.
May 14 04:30:00.472045 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'resources' on Instance uuid c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:00.731189 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:00.747952 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:00.877945 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.910926 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Creating config drive at /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config
May 14 04:30:00.915743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0evymaf_ {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:00.975238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-187578080',display_name='tempest-VolumesSnapshotTestJSON-instance-187578080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-187578080',id=24,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWo4zXsbWUWjk0BvO2FPkLXhg6DRNxDI7tcC0lqlGGflNfsKjpL2X/6/sxW3/Rp/25TNsxbGP8nTsE9KqaY74+oPCuO+1tMp0pqhjxM5z9WK0yXusajidOpHb4rG2c5Hg==',key_name='tempest-keypair-627248677',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:55Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-uofop6p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=c9c24a0e-4ee9-409f-83cc-e86bcd4152a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:00.975750 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "address": "fa:16:3e:25:43:ad", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17b4b-22", "ovs_interfaceid": "3be17b4b-22ed-4612-9b0c-51594e6f1ba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:00.976653 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:00.977156 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:00.978689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.978998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be17b4b-22, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:00.982935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:00.986126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0evymaf_" returned: 0 in 0.071s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:00.987341 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.988485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.988658 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fef2956-9d7a-45e0-a190-3aa03a568e02) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:00.989548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:00.990141 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:00.996006 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.000189 np0000000747 nova-compute[97971]: INFO os_vif [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:43:ad,bridge_name='br-int',has_traffic_filtering=True,id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17b4b-22')
May 14 04:30:01.004145 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:30:01.004695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:01.004888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:01.037406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Found WWN 33000000065b076c9 for multipath device dm-8 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:30:01.038031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:01.038435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== connect_volume: return (5943ms) {'type': 'block', 'scsi_wwn': '33000000065b076c9', 'path': '/dev/dm-8', 'multipath_id': '33000000065b076c9'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:01.038748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000065b076c9', 'path': '/dev/dm-8', 'multipath_id': '33000000065b076c9'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:30:01.039175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:01.040251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e821ab90-ad69-46d1-8cfc-948a6eeae50c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:30:01.040749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:30:01.076864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:01.077102 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:01.079800 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:01.080090 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:01.080090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:30:01.080413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:30:01.080413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:30:01.080413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:30:01.080503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e821ab90-ad69-46d1-8cfc-948a6eeae50c') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:30:01.080833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618279300>, {}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:30:01.080833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Disconnecting from: [] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:30:01.080979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:01.081039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== disconnect_volume: return (76ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:01.081106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:30:01.081347 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Deleting instance files /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2_del
May 14 04:30:01.082144 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Deletion of /opt/stack/data/nova/instances/c9c24a0e-4ee9-409f-83cc-e86bcd4152a2_del complete
May 14 04:30:01.249327 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Took 1.46 seconds to deallocate network for instance.
May 14 04:30:01.508445 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.548925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.552427 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:30:01.552427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:01.552427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:01.552427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:01.553929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:30:01.571054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:01.572703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:01.573035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:01.573302 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:30:01.577816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:01.578036 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:30:01.580293 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:01.594668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:30:01.594668 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:01.596778 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:30:01.596778 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:01.601563 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Took 1.48 seconds to destroy the instance on the hypervisor.
May 14 04:30:01.602889 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:30:01.603138 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:30:01.603352 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:30:01.603541 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:01.611573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c] added
May 14 04:30:01.611573 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:30:01.611573 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:30:01.611573 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:30:01.611573 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:30:01.611573 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:30:01.611573 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:01.611887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:30:01.612076 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:30:01.612288 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c] added
May 14 04:30:01.619130 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:30:01.619130 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:01.619130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:30:01.619594 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:30:01.619594 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:30:01.682239 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.684478 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.690507 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:01.745416 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:01.765638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:01.778758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77fac270-29f7-41c1-baa8-86e84a7b8655 req-047b7f71-a8c9-481c-84dc-a729d22498d0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:01.778995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77fac270-29f7-41c1-baa8-86e84a7b8655 req-047b7f71-a8c9-481c-84dc-a729d22498d0 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:01.779263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77fac270-29f7-41c1-baa8-86e84a7b8655 req-047b7f71-a8c9-481c-84dc-a729d22498d0 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:01.781067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77fac270-29f7-41c1-baa8-86e84a7b8655 req-047b7f71-a8c9-481c-84dc-a729d22498d0 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:01.781356 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77fac270-29f7-41c1-baa8-86e84a7b8655 req-047b7f71-a8c9-481c-84dc-a729d22498d0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Processing event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:02.089730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.950s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:02.091813 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.328s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:02.229776 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Deleted allocations for instance 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Received event network-vif-deleted-cc91f949-0929-4282-a5c9-6ae4147a7c9e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:02.368757 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] No waiting events found dispatching network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:02.370028 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:02.373319 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:02.376691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Acquiring lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:02.376691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:02.376691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:02.376691 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] No waiting events found dispatching network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:02.376691 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0d2af3d9-6cfe-4c8b-b836-da4feac5972f req-7d0df8d2-85d9-43ca-b916-150d76f4fc1a service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-unplugged-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:02.612952 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:30:02.620426 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:02.629796 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:02.629796 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:02.642854 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:02.642854 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.648217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.648217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-07621527-c35d-4e06-b9e9-9b9834f1e88f req-0f497e07-913d-4018-aa2b-d6da5f476b35 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Received event network-vif-deleted-3be17b4b-22ed-4612-9b0c-51594e6f1ba6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:02.648217 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-07621527-c35d-4e06-b9e9-9b9834f1e88f req-0f497e07-913d-4018-aa2b-d6da5f476b35 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Neutron deleted interface 3be17b4b-22ed-4612-9b0c-51594e6f1ba6; detaching it from the instance and deleting it from the info cache
May 14 04:30:02.648217 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-07621527-c35d-4e06-b9e9-9b9834f1e88f req-0f497e07-913d-4018-aa2b-d6da5f476b35 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:02.665702 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.676818 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.677272 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.696338 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:02.729920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.40.100,3260]
May 14 04:30:02.729920 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.40.100,3260] successful.
May 14 04:30:02.729920 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.747499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.762736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.50.100,3260]
May 14 04:30:02.762736 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.50.100,3260] successful.
May 14 04:30:02.762736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.772810 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.773304 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:02.773806 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:02.773806 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:02.775194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('19', '-', '-', 0) found on session 61 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:02.775319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:02.784417 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:02.794544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 61 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:02.794544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.807603 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:02.808185 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:02.808878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:02.808878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:02.810545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] HCTL ('20', '-', '-', 0) found on session 62 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:02.810707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:02.833030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Searching for a device in session 62 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:02.833180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:02.872703 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733002.8722208, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:02.872912 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Started (Lifecycle Event)
May 14 04:30:02.878587 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:02.883427 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:02.884427 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance spawned successfully.
May 14 04:30:02.884924 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:03.052468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:03.052718 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:03.079203 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:03.155913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-07621527-c35d-4e06-b9e9-9b9834f1e88f req-0f497e07-913d-4018-aa2b-d6da5f476b35 service nova] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Detach interface failed, port_id=3be17b4b-22ed-4612-9b0c-51594e6f1ba6, reason: Instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:30:03.243605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-93b6ca55-59b7-4f55-8433-4e25b523a5a1 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Lock "3efd7e68-1f22-4e3a-b47a-137c24a1fe8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.907s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:03.377379 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:03.379730 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:03.395581 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.395823 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.396275 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.396667 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.397238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.397519 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:03.555632 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:03.580455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:30:03.581070 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Took 1.98 seconds to deallocate network for instance.
May 14 04:30:03.606000 np0000000747 nova-compute[97971]: WARNING nova.volume.cinder [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Attachment a9061695-7d7e-4670-9658-2b1d7d2bf0e7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a9061695-7d7e-4670-9658-2b1d7d2bf0e7. (HTTP 404) (Request-ID: req-db48b537-5083-4006-ae01-89c4fe2a3bd0)
May 14 04:30:03.606327 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Took 0.02 seconds to detach 1 volumes for instance.
May 14 04:30:03.865409 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:03.867139 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:03.867226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:03.867364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:03.867574 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:03.867802 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-28c86dbb-d741-4e2b-901f-8165558c8949 req-ce68f5e8-6e15-40f2-a5ac-b696a05711b6 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state building and task_state spawning.
May 14 04:30:03.882240 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:30:03.883507 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733003.8823218, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:03.883507 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Paused (Lifecycle Event)
May 14 04:30:03.903273 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Took 10.60 seconds to spawn the instance on the hypervisor.
May 14 04:30:03.903432 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:04.062424 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.973s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:04.112810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:04.112992 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:04.120215 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Deleted allocations for instance fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa
May 14 04:30:04.385162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:04.387979 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733004.387674, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:04.388136 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Resumed (Lifecycle Event)
May 14 04:30:04.413861 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Took 22.50 seconds to build instance.
May 14 04:30:04.603420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Found WWN 33000000057131735 for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:30:04.605462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:04.605462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '33000000057131735', 'path': '/dev/dm-9', 'multipath_id': '33000000057131735'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:04.605462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000057131735', 'path': '/dev/dm-9', 'multipath_id': '33000000057131735'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:30:04.839511 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:04.839761 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:04.891425 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:04.895662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:04.918738 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fe4242d4-dd9c-4672-8bb2-aa1ac7bd7afe tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.021s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.113692 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.113925 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.114537 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.115535 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.118760 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.119723 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.123362 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.123588 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.124221 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.125352 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.125352 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.126693 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.128380 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.128785 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.129700 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.130559 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.130786 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.131286 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.132067 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:05.134222 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.134630 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.135233 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lazy-loading 'pci_devices' on Instance uuid 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:05.136842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3675f28f-5163-4bee-8524-0e9dd4a3337b tempest-ServerActionsTestOtherA-1166153365 tempest-ServerActionsTestOtherA-1166153365-project-member] Lock "fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.272s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.235536 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0006837669998276397 future=<Future at 0x7435f8384e60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.235699 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.235780 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.566763000000037 future=<Future at 0x7436183b7410 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.235863 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.5666727430000265 future=<Future at 0x7436183b7410 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.235916 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.235996 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.952145129999963 future=<Future at 0x7435f844c590 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.236057 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.952076232000081 future=<Future at 0x7435f844c590 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:05.236279 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Emitting event <LifecycleEvent: 1778732990.2347248, ec7eb127-aa14-4632-aadd-d50696b45625 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:05.236389 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] VM Stopped (Lifecycle Event)
May 14 04:30:05.251583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.343768 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:05.503419 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Stashing vm_state: active {{(pid=97971) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 14 04:30:05.641935 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <uuid>26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949</uuid>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <name>instance-0000001d</name>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:name>tempest-device-tagging-server-569458513</nova:name>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:29:51</nova:creationTime>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:user uuid="640e693a251443fdb4b297994247b01b">tempest-TaggedBootDevicesTest_v242-2056355007-project-member</nova:user>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:project uuid="434cba1835e7445d88c5e06f8000f80b">tempest-TaggedBootDevicesTest_v242-2056355007</nova:project>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="679826a3-26c9-405f-a2f3-34d4340134b5">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="93d1a992-d312-47c0-bd27-02005cfdb5f5">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="96b18678-fcba-44b3-ba6b-adbe5544a062">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="071b8798-7c20-4bc2-9085-1189c5639d06">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="ce04dea8-56f7-46d5-9f5c-3b3691f4c554">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="28dc8cbf-1b8d-4085-9933-374f3afb1375">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         <nova:port uuid="d2dcc064-5740-4e0a-a1b5-21d988064509">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="serial">26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="uuid">26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/disk.config"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <alias name="ua-acfa5344-cf79-45e9-a4d8-a0099b8b321a"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <serial>acfa5344-cf79-45e9-a4d8-a0099b8b321a</serial>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <alias name="ua-be24eba5-bbd0-423c-a3d1-e85718a1b9d0"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-8"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <serial>be24eba5-bbd0-423c-a3d1-e85718a1b9d0</serial>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <alias name="ua-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-9"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="vdc" bus="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <serial>5e6cf1e8-a1bf-4634-9d5e-b6427a99928c</serial>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:79:50:06"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tap679826a3-26"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:bd:06:c6"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tap93d1a992-d3"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:8a:34:ca"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tap96b18678-fc"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1d:1c:50"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tap071b8798-7c"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:db:7d:33"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tapce04dea8-56"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:47:49:42"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tap28dc8cbf-1b"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:f6:49:7f"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <target dev="tapd2dcc064-57"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/console.log" append="off"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:05.641935 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.644916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.646877 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.647110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.647779 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Preparing to wait for external event network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:05.647779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:05.647779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:05.648048 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.648792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.649348 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.649583 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.649895 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.650168 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.650435 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.650671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.651744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.651744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7cd0b11-697a-5ae6-bd29-0a61d315491a', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.652648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.653575 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.653835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.661302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.661302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap679826a3-26, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.661890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap679826a3-26, col_values=(('qos', UUID('4b2affab-a2c3-48c4-9aa6-ef3c049bbea8')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.662272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap679826a3-26, col_values=(('external_ids', {'iface-id': '679826a3-26c9-405f-a2f3-34d4340134b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:50:06', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.663843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.665254 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.670455 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.671629 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26')
May 14 04:30:05.672493 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.672723 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.673479 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.673650 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.674299 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.674815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.674939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.675928 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.676116 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0237f0a-5212-54ad-8138-49a9ed2abfeb', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.676880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.677784 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.683786 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.686535 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.686920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93d1a992-d3, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.687352 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93d1a992-d3, col_values=(('qos', UUID('745bebf6-5124-4f5f-ba72-03cc369a10db')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.687557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93d1a992-d3, col_values=(('external_ids', {'iface-id': '93d1a992-d312-47c0-bd27-02005cfdb5f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:06:c6', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.688775 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.691327 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.699759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.700953 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3')
May 14 04:30:05.701820 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.702001 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.702576 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.702848 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.703368 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.703769 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.703949 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.705007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.705207 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '406a1e53-758d-5920-8118-83073c8a6834', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.706089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.706862 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.717962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.723760 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.724032 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96b18678-fc, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.724280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96b18678-fc, col_values=(('qos', UUID('cca82611-5802-4d2a-b302-a849162a7675')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.724440 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96b18678-fc, col_values=(('external_ids', {'iface-id': '96b18678-fcba-44b3-ba6b-adbe5544a062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:34:ca', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.725737 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.728334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.745260 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: ec7eb127-aa14-4632-aadd-d50696b45625] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:05.745681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.747152 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc')
May 14 04:30:05.749968 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.750435 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.751097 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.751262 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.752294 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.752522 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.752739 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.753590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.753780 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0467a03-f00c-5096-a0bd-30bbae3ca2de', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.755389 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.756154 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.772059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.774456 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.774574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap071b8798-7c, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.774925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap071b8798-7c, col_values=(('qos', UUID('e25ca98a-3503-4f8b-a31b-5f8ea003f666')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.775099 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap071b8798-7c, col_values=(('external_ids', {'iface-id': '071b8798-7c20-4bc2-9085-1189c5639d06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:1c:50', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.776162 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.777492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.798218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.799484 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c')
May 14 04:30:05.800491 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.800802 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.801489 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.801772 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.801997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.802197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.802382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.803585 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.803809 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be2e1e30-102e-5a3a-946c-4988832b8caa', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.804744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.805461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.831910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.835461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.835461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce04dea8-56, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.835461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce04dea8-56, col_values=(('qos', UUID('c8f21fc2-0510-42f2-b317-6868c2fc963f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.835676 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce04dea8-56, col_values=(('external_ids', {'iface-id': 'ce04dea8-56f7-46d5-9f5c-3b3691f4c554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:7d:33', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.836833 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.839239 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.853451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.740s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:05.862026 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.863316 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56')
May 14 04:30:05.864139 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.864360 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.865388 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.865522 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.865715 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.866106 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.866376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.867673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.868053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccf0f701-3aa4-5c2f-a287-9a9cc7485d8f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.869149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.869985 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.901222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.906550 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.906826 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28dc8cbf-1b, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.907244 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28dc8cbf-1b, col_values=(('qos', UUID('712b8a4c-ec06-4733-9521-b2965d89dc6a')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.907418 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28dc8cbf-1b, col_values=(('external_ids', {'iface-id': '28dc8cbf-1b8d-4085-9933-374f3afb1375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:49:42', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.910111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.912135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:05.932523 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Deleted allocations for instance c9c24a0e-4ee9-409f-83cc-e86bcd4152a2
May 14 04:30:05.954002 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.954002 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b')
May 14 04:30:05.954002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:05.954002 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:05.954002 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:05.954826 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:05.961943 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.962191 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.962414 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:05.969987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.970263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41e20977-5af5-504c-b216-64d93089ae31', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:05.971386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:05.972365 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:06.062377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:06.062568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:06.074407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:06.079264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:06.079443 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:06.080138 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2dcc064-57, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:06.080524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2dcc064-57, col_values=(('qos', UUID('669e5095-ee85-4703-ae3e-7bb77764e93d')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:06.080738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2dcc064-57, col_values=(('external_ids', {'iface-id': 'd2dcc064-5740-4e0a-a1b5-21d988064509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:49:7f', 'vm-uuid': '26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:06.084213 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:06.085762 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:06.122863 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:06.125822 np0000000747 nova-compute[97971]: INFO os_vif [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57')
May 14 04:30:06.573136 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:06.573545 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Claim successful on node np0000000747
May 14 04:30:06.615796 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Rescuing
May 14 04:30:06.616821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:06.616821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:06.616821 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:06.952506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-722f1adc-41ea-49ee-8f68-1344308eb4fa tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "c9c24a0e-4ee9-409f-83cc-e86bcd4152a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.343s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:07.080105 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating resource usage from migration d5e76812-a3f1-408b-95e0-b7496131294c
May 14 04:30:07.120518 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:07.494661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:07.650248 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:07.650668 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:07.650668 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] No VIF found with MAC fa:16:3e:79:50:06, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:07.650926 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] No VIF found with MAC fa:16:3e:db:7d:33, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:07.651533 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Using config drive
May 14 04:30:07.783859 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:07.793662 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:07.795557 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:07.935983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:08.160988 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:08.296664 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:08.352259 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Creating config drive at /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/disk.config
May 14 04:30:08.358302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp11eihyyy {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:08.416905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp11eihyyy" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:08.422177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:08.439977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:08.805221 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.743s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:08.805730 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Migrating
May 14 04:30:08.805730 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:30:08.984908 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.041803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.043182 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.103524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.105110 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.238663 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.250689 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2b77a658-bc98-484d-bc65-a3bb52113588 req-9ef8e69e-bf24-467b-82dd-3d02dd974dae service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:09.250689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b77a658-bc98-484d-bc65-a3bb52113588 req-9ef8e69e-bf24-467b-82dd-3d02dd974dae service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:09.251743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b77a658-bc98-484d-bc65-a3bb52113588 req-9ef8e69e-bf24-467b-82dd-3d02dd974dae service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:09.252013 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2b77a658-bc98-484d-bc65-a3bb52113588 req-9ef8e69e-bf24-467b-82dd-3d02dd974dae service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:09.252230 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2b77a658-bc98-484d-bc65-a3bb52113588 req-9ef8e69e-bf24-467b-82dd-3d02dd974dae service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:09.274240 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.278304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.283984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.329136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:09.329288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:09.329471 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:09.330583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.377192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.389924 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.427938 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.445561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.453842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.490638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.509869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.510910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.531758 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.578396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.680160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.690293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.787256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.794828 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a68ae47f-9607-47fa-a67b-50bbec1c4f96 req-048b5aa0-d293-4ce7-aa61-c73b6ecaa6f7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:09.794828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a68ae47f-9607-47fa-a67b-50bbec1c4f96 req-048b5aa0-d293-4ce7-aa61-c73b6ecaa6f7 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:09.794828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a68ae47f-9607-47fa-a67b-50bbec1c4f96 req-048b5aa0-d293-4ce7-aa61-c73b6ecaa6f7 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:09.794918 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a68ae47f-9607-47fa-a67b-50bbec1c4f96 req-048b5aa0-d293-4ce7-aa61-c73b6ecaa6f7 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:09.795075 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a68ae47f-9607-47fa-a67b-50bbec1c4f96 req-048b5aa0-d293-4ce7-aa61-c73b6ecaa6f7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:09.798926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.829880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.835119 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:09.865099 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:09.972468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.050872 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.082210 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.123077 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.132464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.155646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.248101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff468827-74c1-4cef-9725-4bcfe047ea4f req-acc3acbd-c66a-4ae1-b76d-e6272287458d service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:10.248809 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff468827-74c1-4cef-9725-4bcfe047ea4f req-acc3acbd-c66a-4ae1-b76d-e6272287458d service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:10.249027 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff468827-74c1-4cef-9725-4bcfe047ea4f req-acc3acbd-c66a-4ae1-b76d-e6272287458d service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:10.249201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff468827-74c1-4cef-9725-4bcfe047ea4f req-acc3acbd-c66a-4ae1-b76d-e6272287458d service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:10.249372 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff468827-74c1-4cef-9725-4bcfe047ea4f req-acc3acbd-c66a-4ae1-b76d-e6272287458d service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:10.362858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.369459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.454909 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999425168000016 future=<Future at 0x7435f85ce420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:10.462499 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance destroyed successfully.
May 14 04:30:10.463119 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'numa_topology' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:10.539836 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.543514 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:10.548156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.712654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.719493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.781299 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:10.904826 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:10.973712 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Attempting a stable device rescue
May 14 04:30:10.998580 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733010.9980998, 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:10.998795 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] VM Started (Lifecycle Event)
May 14 04:30:11.082314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:30:11.082766 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.088952 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:30:11.089365 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Creating image(s)
May 14 04:30:11.090185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.090353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.090971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.091291 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:11.101085 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.111142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.144767 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.153048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.286384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:11.347034 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.347474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No event matching network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 in dict_keys([('network-vif-plugged', '93d1a992-d312-47c0-bd27-02005cfdb5f5'), ('network-vif-plugged', '96b18678-fcba-44b3-ba6b-adbe5544a062'), ('network-vif-plugged', 'ce04dea8-56f7-46d5-9f5c-3b3691f4c554'), ('network-vif-plugged', '28dc8cbf-1b8d-4085-9933-374f3afb1375')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-679826a3-26c9-405f-a2f3-34d4340134b5 for instance with vm_state building and task_state spawning.
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.348726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.349308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.349308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.349308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:11.349308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.349453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.349506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.349735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.349870 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No event matching network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 in dict_keys([('network-vif-plugged', '96b18678-fcba-44b3-ba6b-adbe5544a062'), ('network-vif-plugged', 'ce04dea8-56f7-46d5-9f5c-3b3691f4c554'), ('network-vif-plugged', '28dc8cbf-1b8d-4085-9933-374f3afb1375')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:30:11.349977 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 for instance with vm_state building and task_state spawning.
May 14 04:30:11.350096 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.350236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.350363 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.350563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.350693 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:11.350810 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.350916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.351348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.351578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.351750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No event matching network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 in dict_keys([('network-vif-plugged', 'ce04dea8-56f7-46d5-9f5c-3b3691f4c554'), ('network-vif-plugged', '28dc8cbf-1b8d-4085-9933-374f3afb1375')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:30:11.351874 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-96b18678-fcba-44b3-ba6b-adbe5544a062 for instance with vm_state building and task_state spawning.
May 14 04:30:11.351960 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.352060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.352278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.352426 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.352519 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:11.352665 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.352897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.353136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.353375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.353474 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No event matching network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 in dict_keys([('network-vif-plugged', '28dc8cbf-1b8d-4085-9933-374f3afb1375')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:30:11.353753 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 for instance with vm_state building and task_state spawning.
May 14 04:30:11.353858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.353986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.354092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.354227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.354332 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa9658a-8ca3-4aa7-8368-26b33ba459cd req-c08958de-a34d-45f3-bfc3-62d5e1d671e9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Processing event network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:11.355738 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:11.363171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:11.366675 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance spawned successfully.
May 14 04:30:11.367185 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:11.430016 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.435966 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.504158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:11.509128 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:11.593377 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:11.593794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.594290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.632437 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.639647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:11.878561 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.879010 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.879681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.883642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.883642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.883642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:11.928198 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:11.928969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:11.928969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:11.928969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:11.928969 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:11.929264 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d3c8e3ff-953d-4099-85f4-15b2bbdfb6b9 req-14a85250-a390-4b66-98ba-16d2f097b1cf service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-071b8798-7c20-4bc2-9085-1189c5639d06 for instance with vm_state building and task_state spawning.
May 14 04:30:12.013439 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:30:12.013439 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733012.0124173, 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:12.013439 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] VM Paused (Lifecycle Event)
May 14 04:30:12.191141 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.002931816999989678 future=<Future at 0x7435f844c590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:12.191895 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:12.191895 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.5476684909999676 future=<Future at 0x7436186d2420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:12.193180 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778732997.188099, 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:12.193180 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] VM Stopped (Lifecycle Event)
May 14 04:30:12.195003 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.5460681049999039 future=<Future at 0x7436186d2420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:12.364159 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:12.365648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:12.365648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:12.365648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:12.365648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:12.366872 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dfc5f596-0b21-4e73-af1b-62f396975e8b req-b92d1776-997c-4686-8b34-2cc71a84f3a8 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-d2dcc064-5740-4e0a-a1b5-21d988064509 for instance with vm_state building and task_state spawning.
May 14 04:30:12.390833 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Took 29.11 seconds to spawn the instance on the hypervisor.
May 14 04:30:12.391006 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:12.480109 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.483849 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.486469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:12.522472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:12.528312 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733012.5278838, 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:12.528468 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] VM Resumed (Lifecycle Event)
May 14 04:30:12.603663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.part --force-share --output=json" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:12.603998 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] 6887cd2a-3bda-4a83-86d5-587144b09013 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:30:12.604696 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:30:12.604965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.part /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:12.708202 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3efd7e68-1f22-4e3a-b47a-137c24a1fe8b] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:12.719546 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.part /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.converted" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:12.727773 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:12.825587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Starting migrate_disk_and_power_off {{(pid=97971) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 14 04:30:12.851131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9.converted --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:12.851841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.258s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:12.852344 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.856203 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.863679 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:12.865095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:12.865390 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:12.865773 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.869844 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:12.869844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:12.896015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:12.918689 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Took 43.05 seconds to build instance.
May 14 04:30:12.995467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9 --force-share --output=json" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:12.995467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9,backing_fmt=raw /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:13.039181 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:13.039789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.048077 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:13.055199 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.060898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba386cb4147749f0ce25b78f8d592052fd786bc9,backing_fmt=raw /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:13.062884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "ba386cb4147749f0ce25b78f8d592052fd786bc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:13.062884 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'migration_context' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:13.193010 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance destroyed successfully.
May 14 04:30:13.194680 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:40Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:13.194958 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:13.197828 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:13.197828 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:13.198188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.198552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b5be577-bb, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:13.206635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.207599 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:13.215407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.217143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.217143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9301b554-ead0-410c-a050-830681c00660) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:13.218604 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.219249 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:13.226980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.229239 np0000000747 nova-compute[97971]: INFO os_vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb')
May 14 04:30:13.376042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:13.420989 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fde4af08-a0ff-454d-90bd-ee95ecb19bc0 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.567s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:13.533798 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:13.534525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:13.534804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:13.534950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:13.535129 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:13.535326 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received unexpected event network-vif-plugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 for instance with vm_state active and task_state None.
May 14 04:30:13.535584 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:13.536237 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:13.536397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:13.536495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:13.536627 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:13.537020 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state active and task_state rescuing.
May 14 04:30:13.537134 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:13.537293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:13.537474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:13.537648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:13.537863 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:13.538101 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f77d0b20-3980-4a5b-9bd0-764b4d803d44 req-c72229b5-990f-4812-b5fd-778fad59d9f1 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state active and task_state rescuing.
May 14 04:30:13.555755 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999667987000066 future=<Future at 0x7435f8403710 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:13.564909 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:13.565285 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:13.566157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start _get_guest_xml network_info=[{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:c9:19:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6887cd2a-3bda-4a83-86d5-587144b09013', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1866bd55-0cf8-447e-9e20-dc7bb25f0289', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, 'status': 'reserved', 'instance': '5faa3a7e-8ade-4e0b-9568-465fc7c61dcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'serial': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:13.566511 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0019205690000489994 future=<Future at 0x7436186d2420 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.7266718630000923 future=<Future at 0x7435f82f45c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.7265226570000323 future=<Future at 0x7435f82f45c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Emitting event <LifecycleEvent: 1778732998.7393017, fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:13.743723 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] VM Stopped (Lifecycle Event)
May 14 04:30:13.804961 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Detected multiple connections on this host for volume: f4c52872-aa09-405c-a76c-6fe1f7b26e53, skipping target disconnect.
May 14 04:30:13.811275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:13.915997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:13.916567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:14.030446 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:14.031124 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:14.033404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:14.071131 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:14.078194 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:14.081485 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014', uuid='5faa3a7e-8ade-4e0b-9568-465fc7c61dcc'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:c9:19:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733014.0803113) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:14.083208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:14.083869 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:14.086450 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:14.086744 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:14.089967 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:14.090437 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:14.090627 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:14.090800 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:14.090944 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:14.092702 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:14.092865 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:14.093067 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:14.093224 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:14.093401 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:14.093511 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:14.093874 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:14.094184 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:14.161296 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:14.165629 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk.config /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:14.208325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk.config /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config" returned: 0 in 0.045s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:14.209313 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk.info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:14.247833 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: fc4ebe11-0b32-401a-ba93-a7e3f9ad48aa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:14.255998 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "cp -r /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_resize/disk.info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" returned: 0 in 0.047s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:14.597331 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:14.613915 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:14.615000 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:30:14.619275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:14.654697 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:14.657490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:14.657770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:14.657953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:14.658125 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:14.658295 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received unexpected event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with vm_state active and task_state resize_migrating.
May 14 04:30:14.658433 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:14.658595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:14.658782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:14.658890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:14.659039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:14.659178 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fd8f880a-2c45-4761-9c4e-c9fcdc8c8668 req-adf5294a-ee0b-49b4-ba05-e1f98c35db28 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received unexpected event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with vm_state active and task_state resize_migrating.
May 14 04:30:14.710080 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:14.710551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:14.710739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:14.711315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:14.711765 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:30:14.712158 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:14.712309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:14.712659 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:14.712851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:30:14.725247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:14.726303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:14.726825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:14.728089 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:30:14.729328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:14.729665 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:14.743309 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:14.743309 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:14.749628 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:14.749628 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:14.760295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:14.770925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.781668 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.782170 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:14.782170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:14.782598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:14.783238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('18', '0', '0', 0) found on session 58 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:14.783377 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:14.795601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 58 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:14.795732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.796406 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:14.796724 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:14.796952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:14.796952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:14.797964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('17', '0', '0', 0) found on session 57 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:14.798107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:14.806761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 57 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:14.807103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:15.313963 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:15.431371 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:15.432274 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:15.469202 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.000872592999940025 future=<Future at 0x7435f82f45c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:15.469376 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:15.469492 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.98450340599993 future=<Future at 0x7435f85ce420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:15.471211 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778733000.468151, c9c24a0e-4ee9-409f-83cc-e86bcd4152a2 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:15.475692 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.980262119999907 future=<Future at 0x7435f85ce420 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:15.475692 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] VM Stopped (Lifecycle Event)
May 14 04:30:15.635119 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Port 6b5be577-bb55-41a2-ae2e-178c3bd132cc binding to destination host np0000000747 is already ACTIVE {{(pid=97971) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 14 04:30:15.730126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:30:15.906595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:15.980235 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e3a62595-59ba-4479-94a0-d3d6d8483fdd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: c9c24a0e-4ee9-409f-83cc-e86bcd4152a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:16.152825 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-changed-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:16.153063 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing instance network info cache due to event network-changed-679826a3-26c9-405f-a2f3-34d4340134b5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:16.153311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] Acquiring lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:16.153492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] Acquired lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:16.153703 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Refreshing network info cache for port 679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:16.602977 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:16.604210 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:30:16.610154 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:16.610696 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:16.611222 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:16.611924 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:16.647929 np0000000747 nova-compute[97971]: DEBUG nova.compute.rpcapi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] RPC: Sending the message to topic: compute-alt {{(pid=97971) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 14 04:30:16.660555 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:16.661098 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:16.661351 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:16.663782 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:16.716887 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:16.717212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:16.750042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Found WWN 3300000008e2a4ac0 for multipath device dm-11 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:30:16.750448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:16.750993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== connect_volume: return (2037ms) {'type': 'block', 'scsi_wwn': '3300000008e2a4ac0', 'path': '/dev/dm-11', 'multipath_id': '3300000008e2a4ac0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:16.750993 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e2a4ac0', 'path': '/dev/dm-11', 'multipath_id': '3300000008e2a4ac0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:30:17.115288 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:17.121825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:17.121825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:17.121825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:17.121825 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:30:17.219908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:30:17.261815 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1799627014',id=30,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:03Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-ofsjtxma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:04Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=5faa3a7e-8ade-4e0b-9568-465fc7c61dcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:c9:19:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:17.261815 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:c9:19:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:17.261815 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:17.261815 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:17.297068 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updated VIF entry in instance network info cache for port 679826a3-26c9-405f-a2f3-34d4340134b5. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:17.297870 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:17.684625 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:17.755026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:17.755238 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:17.755402 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:17.764183 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:17.765718 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <uuid>5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</uuid>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <name>instance-0000001e</name>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1799627014</nova:name>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:14</nova:creationTime>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         <nova:port uuid="7ed5d49e-dce2-42e3-8dbc-7b130844d6d1">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="serial">5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="uuid">5faa3a7e-8ade-4e0b-9568-465fc7c61dcc</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <alias name="ua-e6f5a8a9-da9a-4850-af03-e9b361fdd494"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-11"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <serial>e6f5a8a9-da9a-4850-af03-e9b361fdd494</serial>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <boot order="1"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:c9:19:d4"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <target dev="tap7ed5d49e-dc"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/console.log" append="off"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:17.765718 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:17.776651 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance destroyed successfully.
May 14 04:30:17.790856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:17.791071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:17.794840 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:17.795215 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Claim successful on node np0000000747
May 14 04:30:17.800164 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20e3cb6c-5b2f-4a56-bb20-16ff9b339612 req-46b4c6e7-aa8d-4c31-b6fd-a9fca76b50d9 service nova] Releasing lock "refresh_cache-26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:18.175075 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.219341 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:18.258359 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:18.268833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.269335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.371096 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.371096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:18.376876 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:18.378127 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:18.378245 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:18.381124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.481930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.482281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.582523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.589278 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:18.589769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.649675 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:18.683554 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.684057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.744559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:18.744967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:18.786798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.rescue --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.793547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:18.821141 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:18.908130 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:18.908885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.020410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.021649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:19.024974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.117413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.118211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.210456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.213920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.248544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:30:19.310121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.310642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.336913 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:19.353397 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:19.353685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:19.353685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:19.353872 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:c9:19:d4, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:19.354952 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Using config drive
May 14 04:30:19.407806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.410178 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:19.411592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.500229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.500755 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.597028 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.597438 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:30:19.603896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.697334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.698401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.777723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:19.778135 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:19.794515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.797148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.830764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:19.860344 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:19.865673 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:19.878948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:30:19.898635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.899350 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.912575 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:19.963413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:30:19.964223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:30:19.973212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:30:19.979446 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::3868:acff:fef0:95f0', 'fe80::fc16:3eff:fe9c:6bd0', 'fe80::fc16:3eff:fe0b:98cf', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe9c:b85b', 'fe80::fc16:3eff:fe79:5006', 'fe80::c83e:eaff:fe1a:2a01', 'fe80::fc16:3eff:febd:6c6', 'fe80::fc16:3eff:fe8a:34ca', 'fe80::fc16:3eff:fe1d:1c50', 'fe80::fc16:3eff:fedb:7d33', 'fe80::fc16:3eff:fe47:4942', 'fe80::cc25:eaff:fe93:a4a4', 'fe80::fc16:3eff:fef6:497f', 'fe80::1824:d5ff:fe14:fedb'] 
May 14 04:30:19.979446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:30:19.979446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:30:19.979446 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:19.985183 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk.rescue --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:19.985609 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:20.076406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:20.077108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:20.165827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:20.169348 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:20.170726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:20.224800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:20.225301 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=11464MB free_disk=73.11220932006836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:30:20.225545 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:20.282939 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:20.368599 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:20.368834 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'keypairs' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:20.790412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.999s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:20.791188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.961s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:20.791708 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:30:20.798703 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:20.798703 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Claim successful on node np0000000747
May 14 04:30:20.873451 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:20.878235 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:20.909629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.019121 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Creating config drive at /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config.rescue
May 14 04:30:21.023160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpavj5js1z {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:21.072930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpavj5js1z" returned: 0 in 0.049s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:21.149634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Starting finish_migration {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 14 04:30:21.151155 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:30:21.151325 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Creating image(s)
May 14 04:30:21.152219 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:21.263335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:21.264174 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:21.264641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:21.311117 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:30:21.311358 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:30:21.311868 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:21.312214 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:21.374663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:21.377101 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Cannot resize image /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:21.399442 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb0d4a5b05c94a7697d02ed951f21543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f783f79d26485a8347214b526fd33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:30:21.570350 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.602131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.686477 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.737922 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.740991 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:21.816713 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:30:21.881096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:30:21.881424 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Ensure instance console log exists: /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:21.881955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:21.882228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:21.882320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:21.887449 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start _get_guest_xml network_info=[{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '599afd7f-5b46-46ae-bcdc-0eca1f504bb7', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '85a9913c-942d-4796-86b3-dc12a56ee6fd', 'attached_at': '2026-05-14T04:30:20.000000', 'detached_at': '', 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'multiattach': True, 'serial': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:21.894812 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:21.896056 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='85a9913c-942d-4796-86b3-dc12a56ee6fd'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733021.895683) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:21.904964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:21.905579 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:21.911232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:21.911590 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:21.913215 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:21.913843 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:21.914048 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:21.914181 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:21.914371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:21.914498 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:21.914873 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:21.915123 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:21.915332 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:21.915640 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:21.916020 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:21.917754 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:21.931550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:21.931902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:21.932125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:21.932661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:21.932661 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:21.933570 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7fa37951-383f-47a9-a9af-4a02aaa5359a req-a3a73a33-fe20-4708-9484-e500fbc893a0 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state active and task_state rescuing.
May 14 04:30:21.938723 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:22.064976 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config --force-share --output=json" returned: 0 in 0.126s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:22.067547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:22.067547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:22.068371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:22.068894 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:30:22.069449 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:22.069693 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:22.070701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:22.070701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:30:22.087434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:22.088197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:22.088911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:22.089250 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:30:22.091375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:22.091564 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:22.111484 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:22.111484 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:30:22.117358 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:30:22.117358 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:22.131764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:22.136197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.155811 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.156326 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:22.156691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:22.156691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:22.157745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('9', '0', '0', 0) found on session 47 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:22.157887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:22.173726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 47 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:22.174003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.176805 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:22.177092 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:22.177421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.086s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:22.177421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:30:22.180268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('10', '0', '0', 0) found on session 48 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:30:22.180268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:30:22.201362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 48 and hctl ('10', '0', '0', 0) yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:30:22.201753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:30:22.327596 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:30:22.358663 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Successfully created port: 63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:30:22.645954 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc due to new event <LifecycleEvent: 1778733022.6452618, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:30:22.648660 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733022.6452618, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:22.648660 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Resumed (Lifecycle Event)
May 14 04:30:22.655867 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3f580c5b-7490-4697-bc98-4abbab0f228b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:22.768161 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:22.768161 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:23.063450 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Successfully updated port: 63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:30:23.090909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:30:23.158465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:23.160788 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:23.234448 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:23.270553 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:23.352829 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:30:23.353923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:30:23.354741 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Creating image(s)
May 14 04:30:23.354896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:23.354978 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:23.355961 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:23.357792 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:23.359280 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:23.361534 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:23.488337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.126s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:23.488878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:23.492643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:23.492643 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:23.494590 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:23.496632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:23.567851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:23.568161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquired lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:23.568362 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:23.605354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:23.605963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:23.667899 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733023.6648526, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:23.667899 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Started (Lifecycle Event)
May 14 04:30:23.684556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk 1073741824" returned: 0 in 0.078s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:23.685113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:23.685544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:23.782163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.991s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:23.783551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.557s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:23.784777 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:30:23.813338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.128s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:23.817213 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:23.817568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:23.938313 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:23.938701 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Cannot resize image /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:23.939085 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:23.939233 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Ensure instance console log exists: /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:23.939515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:23.939754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:23.939909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:24.009447 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:24.009716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state rescued and task_state unrescuing.
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-changed-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:24.010582 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Refreshing instance network info cache due to event network-changed-63094e41-ebd7-481f-a17f-8931686f90d7. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:24.011698 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Acquiring lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:24.111040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 3300000000ad49717 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:30:24.111476 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:24.112117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (2041ms) {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:24.112117 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000ad49717', 'path': '/dev/dm-6', 'multipath_id': '3300000000ad49717'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:30:24.165539 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:24.171638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:24.174012 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:24.295450 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:30:24.295867 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:30:24.296073 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:24.296411 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:24.387468 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Unrescuing
May 14 04:30:24.387468 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:24.388945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:24.389242 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:24.393494 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:24.416174 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d28aa2d5d8d4d42931857f8b63ad188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1481ce79a54b72a2f83aa185ea46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:30:24.596468 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating instance_info_cache with network_info: [{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:24.624648 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:40Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:24.624648 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:24.624648 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:24.629468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <uuid>85a9913c-942d-4796-86b3-dc12a56ee6fd</uuid>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <name>instance-00000016</name>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <memory>262144</memory>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:name>multiattach-server-1</nova:name>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:21</nova:creationTime>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.micro" id="84">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:memory>256</nova:memory>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         <nova:port uuid="6b5be577-bb55-41a2-ae2e-178c3bd132cc">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="serial">85a9913c-942d-4796-86b3-dc12a56ee6fd</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="uuid">85a9913c-942d-4796-86b3-dc12a56ee6fd</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk.config"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-6"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <shareable/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:f4:99:43"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <target dev="tap6b5be577-bb"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/console.log" append="off"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:24.629468 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:24.629468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:40Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000747',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:24.629468 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "vif_mac": "fa:16:3e:f4:99:43"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:24.633192 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:24.633192 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:24.633192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.633192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:24.633192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:24.633636 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.633878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e77f07b-aff5-56de-ab4c-99dd0cca9d98', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:24.634829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.635752 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:24.636514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.639511 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.639726 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b5be577-bb, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:24.640149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b5be577-bb, col_values=(('qos', UUID('d005c537-39fa-41ea-920d-500db9b4d8bb')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:24.640406 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b5be577-bb, col_values=(('external_ids', {'iface-id': '6b5be577-bb55-41a2-ae2e-178c3bd132cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:99:43', 'vm-uuid': '85a9913c-942d-4796-86b3-dc12a56ee6fd'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:24.641384 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.643312 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:24.650573 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:24.654285 np0000000747 nova-compute[97971]: INFO os_vif [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb')
May 14 04:30:24.677873 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 04:30:24.801394 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:30:24.819117 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Applying migration context for instance 85a9913c-942d-4796-86b3-dc12a56ee6fd as it has an incoming, in-progress migration d5e76812-a3f1-408b-95e0-b7496131294c. Migration status is post-migrating {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 14 04:30:24.824523 np0000000747 nova-compute[97971]: INFO nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating resource usage from migration d5e76812-a3f1-408b-95e0-b7496131294c
May 14 04:30:24.898461 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:24.932759 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.932759 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.932929 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5d42ebce-6d76-4893-b335-bceb7181a83a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.933144 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 09eb687f-f8dd-4062-b883-f2211b86533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.933144 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.933285 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance a7b6e4bf-576f-438e-907f-71fef72b19b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.934089 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3370940d-3bd7-45f3-887f-9c515137a348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.934089 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4d665afc-c146-44a9-af0b-e36fcd96568a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.934089 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.934283 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.934328 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Migration d5e76812-a3f1-408b-95e0-b7496131294c is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 14 04:30:24.934393 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 85a9913c-942d-4796-86b3-dc12a56ee6fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.935897 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance be285f62-66b7-4e5c-84a6-077afe0a69fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.935897 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 8535c256-4cff-4edb-9e78-23028fb7a32d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:30:24.935897 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:30:24.935897 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=3328MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:30:20 up 30 min,  2 users,  load average: 10.75, 7.51, 3.72\n', 'num_instances': '13', 'num_vm_active': '9', 'num_task_None': '11', 'num_os_type_None': '13', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '5', 'io_workload': '2', 'num_proj_cfaef82fed39403a80c7ec4baa8ad091': '3', 'num_vm_rescued': '2', 'num_task_resize_finish': '1', 'num_proj_3030a0d75e9c41828981f529272fd47f': '2', 'num_proj_434cba1835e7445d88c5e06f8000f80b': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_59f783f79d26485a8347214b526fd33a': '1', 'num_proj_9e1481ce79a54b72a2f83aa185ea46d1': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:30:25.022718 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Successfully created port: 7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:30:25.098386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Releasing lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:25.099328 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Instance network_info: |[{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:30:25.099655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Acquired lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:25.099747 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Refreshing network info cache for port 63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:25.105191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Start _get_guest_xml network_info=[{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:25.112141 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:25.114377 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-102335604', uuid='be285f62-66b7-4e5c-84a6-077afe0a69fb'), owner=OwnerMeta(userid='fb0d4a5b05c94a7697d02ed951f21543', username='tempest-VolumesSnapshotTestJSON-9761619-project-member', projectid='59f783f79d26485a8347214b526fd33a', projectname='tempest-VolumesSnapshotTestJSON-9761619'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733025.1138537) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:25.116288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:25.116840 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:25.118884 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:25.119240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:25.120575 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:25.121297 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:25.121297 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:25.121426 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:25.122001 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:25.122001 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:25.122001 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:25.122260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:25.122307 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:25.122451 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:25.122638 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:25.122820 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:25.146115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102335604',display_name='tempest-VolumesSnapshotTestJSON-instance-102335604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-102335604',id=31,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW7EyGr2pR3V6eyDUjcfrzGTBupEzJOQBuxELdRAySd9brd4hRs4wBFLYSza0jYC4ksf3y9kc+UQxf//+8zd51OtL8s/oeSGdNcQ4wLEhAZU+cCWfWFAtZYiWmDI0owng==',key_name='tempest-keypair-955635961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-fzyi9y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=be285f62-66b7-4e5c-84a6-077afe0a69fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:25.146115 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:25.146931 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:25.148833 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'pci_devices' on Instance uuid be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:25.304933 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:30:25.426156 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:25.454391 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00034407099997224577 future=<Future at 0x7435f85ce420 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:25.454504 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:25.454677 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.1002786700000797 future=<Future at 0x7435f8403710 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:25.454730 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.1001578860000336 future=<Future at 0x7435f8403710 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:25.592402 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [{"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:25.603346 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:25.653371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <uuid>be285f62-66b7-4e5c-84a6-077afe0a69fb</uuid>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <name>instance-0000001f</name>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-102335604</nova:name>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:25</nova:creationTime>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:user uuid="fb0d4a5b05c94a7697d02ed951f21543">tempest-VolumesSnapshotTestJSON-9761619-project-member</nova:user>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:project uuid="59f783f79d26485a8347214b526fd33a">tempest-VolumesSnapshotTestJSON-9761619</nova:project>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         <nova:port uuid="63094e41-ebd7-481f-a17f-8931686f90d7">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="serial">be285f62-66b7-4e5c-84a6-077afe0a69fb</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="uuid">be285f62-66b7-4e5c-84a6-077afe0a69fb</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.config"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e3:ca:63"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <target dev="tap63094e41-eb"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/console.log" append="off"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:25.653371 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:25.653371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Preparing to wait for external event network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:25.653371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:25.658460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.006s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:25.659537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:25.662173 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102335604',display_name='tempest-VolumesSnapshotTestJSON-instance-102335604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-102335604',id=31,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW7EyGr2pR3V6eyDUjcfrzGTBupEzJOQBuxELdRAySd9brd4hRs4wBFLYSza0jYC4ksf3y9kc+UQxf//+8zd51OtL8s/oeSGdNcQ4wLEhAZU+cCWfWFAtZYiWmDI0owng==',key_name='tempest-keypair-955635961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-fzyi9y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=be285f62-66b7-4e5c-84a6-077afe0a69fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:25.662173 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:25.662173 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:25.662173 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:25.662515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.663787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:25.664352 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:25.665883 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.666185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c17a13be-1e8d-5ca5-8df4-eb8f5d4b2e56', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:25.668201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.668398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:25.677379 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.680987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.681242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63094e41-eb, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:25.681669 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63094e41-eb, col_values=(('qos', UUID('dc8d35b2-fa86-4033-8751-b9cda8d1a492')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:25.681828 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63094e41-eb, col_values=(('external_ids', {'iface-id': '63094e41-ebd7-481f-a17f-8931686f90d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:ca:63', 'vm-uuid': 'be285f62-66b7-4e5c-84a6-077afe0a69fb'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:25.682805 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.684187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:25.688058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:25.688058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:25.688058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:25.688058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:f4:99:43, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:25.688058 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Using config drive
May 14 04:30:25.691122 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Successfully updated port: 7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:30:25.698304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:25.704331 np0000000747 nova-compute[97971]: INFO os_vif [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb')
May 14 04:30:25.755465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-changed-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:25.757223 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Refreshing instance network info cache due to event network-changed-7b342f78-e288-4c8c-a6af-10acc55dd024. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:25.757414 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] Acquiring lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:25.757550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] Acquired lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:25.757734 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Refreshing network info cache for port 7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:25.846779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:25.846779 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:25.911433 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.002253 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:26.095179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:26.095856 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'flavor' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:26.162634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.171567 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updated VIF entry in instance network info cache for port 63094e41-ebd7-481f-a17f-8931686f90d7. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:26.171567 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating instance_info_cache with network_info: [{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:26.197007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:26.199893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.204594 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.261045 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:26.289880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.320904 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:30:26.322861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:30:26.323451 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Creating image(s)
May 14 04:30:26.324405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:26.325353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:26.327841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:26.327841 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:26.332486 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.334119 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:26.336428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:26.349235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.356355 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:26.360294 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:26.448642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:26.448642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:26.448642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:26.449216 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:26.455322 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:26.455726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:26.552583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:26.554057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:26.620843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk 1073741824" returned: 0 in 0.063s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:26.620843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:26.620843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:26.650956 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.662827 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:26.673763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0e70eb74-f204-4fa0-b307-ae630b36cab4 req-f4fb4fad-e639-4972-bb1e-b2fe12c48c4f service nova] Releasing lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:26.679774 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.743792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:26.744290 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:26.744639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:26.802811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.815653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.828951 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:26.829768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:26.830067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:26.830275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:26.830499 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:26.830711 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-3230108c-bcc3-4992-88f4-2f41a33adc76 req-e5c5256a-e445-48f7-8357-7fe2f7ef5cc9 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state rescued and task_state unrescuing.
May 14 04:30:26.857546 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:26.858088 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Cannot resize image /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:26.858545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:26.858730 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Ensure instance console log exists: /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:26.859005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:26.859256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:26.859331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:26.881640 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:30:26.881640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.096s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:26.881640 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:30:26.955551 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.973195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:26.988788 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999658918000023 future=<Future at 0x7435f8566ff0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:26.990901 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance destroyed successfully.
May 14 04:30:26.991560 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'numa_topology' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:27.169656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76dc8a60-0ff9-42e4-b6f6-b14cca5f3443 req-66728f09-1bb1-4a4d-8bd3-ce03e89f254f service nova] Releasing lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:27.170433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquired lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:27.170699 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:27.214642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 85a9913c-942d-4796-86b3-dc12a56ee6fd due to new event <LifecycleEvent: 1778733027.2134132, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:30:27.214642 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733027.2134132, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:27.214642 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Resumed (Lifecycle Event)
May 14 04:30:27.216256 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:27.220611 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance running successfully.
May 14 04:30:27.224635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Failed to set time: agent not configured {{(pid=97971) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 14 04:30:27.224635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7dfc7d1a-8a0b-4b0a-99c3-0026501800fd tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] finish_migration finished successfully. {{(pid=97971) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 14 04:30:27.235345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:27.235506 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:27.235650 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No VIF found with MAC fa:16:3e:e3:ca:63, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:27.236166 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Using config drive
May 14 04:30:27.495772 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<5faa3a7e-8ade-4e0b-9568-465fc7c61dcc> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:27.717731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:27.721722 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:27.742471 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:27.754123 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:27.843126 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:27.843340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:27.843520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:27.843686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:27.843836 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:27.843989 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received unexpected event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with vm_state active and task_state resize_finish.
May 14 04:30:27.844196 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:27.846480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:27.846702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:27.846930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:27.847276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:27.847276 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-02095659-df9d-4e90-b097-f6a5816d7781 req-59b81dc3-5e0b-4e0a-8bb5-8334aca4ebbd service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received unexpected event network-vif-plugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with vm_state active and task_state resize_finish.
May 14 04:30:27.870356 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:27.870356 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:27.870737 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:30:27.871259 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:30:27.871506 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.74 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:30:27.933368 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Creating config drive at /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.config
May 14 04:30:27.937743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9atataub {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:28.008123 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.018771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9atataub" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:28.031103 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:28.051912 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.056381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.148711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.156817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.169512 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.217456 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating instance_info_cache with network_info: [{"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:28.224761 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 14 04:30:28.225122 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733028.2249331, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:28.225226 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Started (Lifecycle Event)
May 14 04:30:28.557972 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.003040271999907418 future=<Future at 0x7435f8403710 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:28.558161 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:28.558161 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.430218407999973 future=<Future at 0x7435f8566ff0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:28.558333 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.430134250000037 future=<Future at 0x7435f8566ff0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:28.597330 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.629451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.642438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.721896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Releasing lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:28.722342 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance network_info: |[{"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:30:28.733752 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:28.737131 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Start _get_guest_xml network_info=[{"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:28.741956 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:28.745816 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.752736 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:28.755146 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-2056876139', uuid='8535c256-4cff-4edb-9e78-23028fb7a32d'), owner=OwnerMeta(userid='6d28aa2d5d8d4d42931857f8b63ad188', username='tempest-AttachVolumeNegativeTest-2053621712-project-member', projectid='9e1481ce79a54b72a2f83aa185ea46d1', projectname='tempest-AttachVolumeNegativeTest-2053621712'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733028.7546577) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:28.762967 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:28.764506 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:28.766714 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:28.766714 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:28.767862 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:28.768304 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:28.768518 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:28.768668 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:28.769699 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:28.769699 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:28.769905 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:28.770089 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:28.770089 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:28.770177 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:28.770331 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:28.770445 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:28.790926 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056876139',display_name='tempest-AttachVolumeNegativeTest-server-2056876139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-2056876139',id=32,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG43TcIy3yaHbT5oWfseu1uLQFpxsBoeJEf994pXf6HdeRcJxGUM5L2+NTTAbc7TiIQotrpIGLYCVqKOb0wvSUtzi7qxKADOX/zKJLMywgKh4ngHJXvVwK5ZGJN6PblcQ==',key_name='tempest-keypair-437880989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-mqf0uvu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=8535c256-4cff-4edb-9e78-23028fb7a32d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:28.791166 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:28.791844 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:28.792682 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'pci_devices' on Instance uuid 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:28.883369 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-344ddf2c-f667-4fff-a7ed-d23cf47bf942 req-b65543e2-eb8a-430d-ae01-ce6b7d0645bd service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:28.885906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-344ddf2c-f667-4fff-a7ed-d23cf47bf942 req-b65543e2-eb8a-430d-ae01-ce6b7d0645bd service nova] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:28.885906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-344ddf2c-f667-4fff-a7ed-d23cf47bf942 req-b65543e2-eb8a-430d-ae01-ce6b7d0645bd service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:28.885906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-344ddf2c-f667-4fff-a7ed-d23cf47bf942 req-b65543e2-eb8a-430d-ae01-ce6b7d0645bd service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:28.885906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-344ddf2c-f667-4fff-a7ed-d23cf47bf942 req-b65543e2-eb8a-430d-ae01-ce6b7d0645bd service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Processing event network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:28.920904 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:28.920904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:28.921107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:28.921476 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:28.921955 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:28.922130 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state rescued and task_state unrescuing.
May 14 04:30:28.922488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:28.922488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:28.922596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:28.922775 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:28.922915 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:28.923045 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state rescued and task_state unrescuing.
May 14 04:30:28.923173 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:28.923328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:28.923478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:28.923632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:28.923772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:28.923901 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0b95c66c-63c0-4fe5-9220-1bacac38a13c req-7b2ccf18-0662-4aec-9b7d-ad946dc20f87 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state rescued and task_state unrescuing.
May 14 04:30:28.978223 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:28.981082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.010786 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.295642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <uuid>8535c256-4cff-4edb-9e78-23028fb7a32d</uuid>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <name>instance-00000020</name>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2056876139</nova:name>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:28</nova:creationTime>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:user uuid="6d28aa2d5d8d4d42931857f8b63ad188">tempest-AttachVolumeNegativeTest-2053621712-project-member</nova:user>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:project uuid="9e1481ce79a54b72a2f83aa185ea46d1">tempest-AttachVolumeNegativeTest-2053621712</nova:project>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         <nova:port uuid="7b342f78-e288-4c8c-a6af-10acc55dd024">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="serial">8535c256-4cff-4edb-9e78-23028fb7a32d</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="uuid">8535c256-4cff-4edb-9e78-23028fb7a32d</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.config"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:06:14:f3"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <target dev="tap7b342f78-e2"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/console.log" append="off"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:29.295642 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Preparing to wait for external event network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056876139',display_name='tempest-AttachVolumeNegativeTest-server-2056876139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-2056876139',id=32,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG43TcIy3yaHbT5oWfseu1uLQFpxsBoeJEf994pXf6HdeRcJxGUM5L2+NTTAbc7TiIQotrpIGLYCVqKOb0wvSUtzi7qxKADOX/zKJLMywgKh4ngHJXvVwK5ZGJN6PblcQ==',key_name='tempest-keypair-437880989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-mqf0uvu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=8535c256-4cff-4edb-9e78-23028fb7a32d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:29.301650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.304882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:29.305195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:29.307460 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.307642 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a5bcb87-d3f7-59a3-ba27-9212ebf354c6', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:29.308793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.309729 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:29.313418 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.319917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.320191 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b342f78-e2, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:29.320653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b342f78-e2, col_values=(('qos', UUID('599d65ed-dd50-4b2d-b3ec-eb51e8ae5c8a')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:29.320891 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b342f78-e2, col_values=(('external_ids', {'iface-id': '7b342f78-e288-4c8c-a6af-10acc55dd024', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:14:f3', 'vm-uuid': '8535c256-4cff-4edb-9e78-23028fb7a32d'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:29.323831 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:29.329122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:29.331732 np0000000747 nova-compute[97971]: INFO os_vif [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2')
May 14 04:30:29.461076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:29.461076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:29.461076 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Going to confirm migration 4 {{(pid=97971) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 14 04:30:29.482476 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc due to new event <LifecycleEvent: 1778733029.4820313, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:30:29.482689 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733029.4820313, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:29.482861 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Resumed (Lifecycle Event)
May 14 04:30:29.485153 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6379fc4d-8422-405c-a509-24ea39bb1693 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:29.640865 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:29.642606 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:29.644316 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Instance spawned successfully.
May 14 04:30:29.644655 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:29.965301 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:29.986329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:29.988966 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:30.124911 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:30.125201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:30.125346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:30.125498 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:30.125911 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'info_cache' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:30.153106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.153265 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.153723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.154214 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.154582 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.154969 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:30.492751 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733030.4924426, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:30.493093 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Started (Lifecycle Event)
May 14 04:30:30.660001 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Took 7.31 seconds to spawn the instance on the hypervisor.
May 14 04:30:30.660212 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:30.859880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:30.860081 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:30.860309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:06:14:f3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:30.860829 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Using config drive
May 14 04:30:30.914600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:30.946129 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:30.947641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:30.947641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:30.947641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:30.947641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] No waiting events found dispatching network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:30.947641 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-29444feb-55d6-4a4d-a143-78c64ee7f949 req-d09a9186-a580-4fbf-884f-029a8f8c116d service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received unexpected event network-vif-plugged-63094e41-ebd7-481f-a17f-8931686f90d7 for instance with vm_state active and task_state None.
May 14 04:30:30.995888 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:30.998570 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:31.133640 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:31.170974 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Took 13.44 seconds to build instance.
May 14 04:30:31.369697 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:31.501062 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733031.5002875, be285f62-66b7-4e5c-84a6-077afe0a69fb => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:31.501516 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] VM Started (Lifecycle Event)
May 14 04:30:31.580017 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:31.583154 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Creating config drive at /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.config
May 14 04:30:31.590938 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpra4_0y09 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:31.667822 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpra4_0y09" returned: 0 in 0.078s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:31.673340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-11d0bc82-f57a-4be5-a8c3-27ba645026ec tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.956s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:31.799828 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:32.004175 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:32.008371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:32.141531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:32.141764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:32.229750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.269648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.274187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.306668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:32.312945 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'migration_context' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:32.371032 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.513774 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733032.5133114, be285f62-66b7-4e5c-84a6-077afe0a69fb => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:32.514392 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] VM Paused (Lifecycle Event)
May 14 04:30:32.645664 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:30:32.653536 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b09f590-31f8-41fc-ab8f-929b4ce68629 req-92064f82-815f-454b-bbb5-8a420a83f8bc service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:32.653789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b09f590-31f8-41fc-ab8f-929b4ce68629 req-92064f82-815f-454b-bbb5-8a420a83f8bc service nova] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:32.653982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b09f590-31f8-41fc-ab8f-929b4ce68629 req-92064f82-815f-454b-bbb5-8a420a83f8bc service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:32.659039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b09f590-31f8-41fc-ab8f-929b4ce68629 req-92064f82-815f-454b-bbb5-8a420a83f8bc service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:32.659039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b09f590-31f8-41fc-ab8f-929b4ce68629 req-92064f82-815f-454b-bbb5-8a420a83f8bc service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Processing event network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:32.683133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.685676 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.687608 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.719858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.820933 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Object Instance<85a9913c-942d-4796-86b3-dc12a56ee6fd> lazy-loaded attributes: info_cache,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:30:32.820933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:32.829413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:32.829855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:32.986703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:32.986859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:33.022541 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:33.025545 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733033.0245898, be285f62-66b7-4e5c-84a6-077afe0a69fb => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:33.025545 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] VM Resumed (Lifecycle Event)
May 14 04:30:33.172082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-changed-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:33.172082 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Refreshing instance network info cache due to event network-changed-63094e41-ebd7-481f-a17f-8931686f90d7. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:33.172082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] Acquiring lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:33.172082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] Acquired lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:33.172082 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Refreshing network info cache for port 63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:33.244356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:33.343520 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:33.347302 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:33.349791 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance spawned successfully.
May 14 04:30:33.350207 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:33.489765 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Detaching volume 608c3b18-74ef-4872-b778-0659c2525b01
May 14 04:30:33.533634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:33.537926 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:33.553387 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Attempting to driver detach volume 608c3b18-74ef-4872-b778-0659c2525b01 from mountpoint /dev/vdb
May 14 04:30:33.558832 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Found disk vdb by alias ua-608c3b18-74ef-4872-b778-0659c2525b01 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:30:33.560177 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Found disk vdb by alias ua-608c3b18-74ef-4872-b778-0659c2525b01 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:30:33.560332 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Attempting to detach device vdb from instance a7b6e4bf-576f-438e-907f-71fef72b19b5 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:30:33.560703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <alias name="ua-608c3b18-74ef-4872-b778-0659c2525b01"/>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <serial>608c3b18-74ef-4872-b778-0659c2525b01</serial>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]: </disk>
May 14 04:30:33.560703 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:30:33.566304 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully detached device vdb from instance a7b6e4bf-576f-438e-907f-71fef72b19b5 from the persistent domain config.
May 14 04:30:33.567671 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] (1/8): Attempting to detach device vdb with device alias ua-608c3b18-74ef-4872-b778-0659c2525b01 from instance a7b6e4bf-576f-438e-907f-71fef72b19b5 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:30:33.567671 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <alias name="ua-608c3b18-74ef-4872-b778-0659c2525b01"/>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <serial>608c3b18-74ef-4872-b778-0659c2525b01</serial>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]: </disk>
May 14 04:30:33.567671 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:30:33.677522 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:33.868001 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:33.868238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:33.868792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:33.869087 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:33.869537 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:33.869868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:34.045041 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733034.044127, 8535c256-4cff-4edb-9e78-23028fb7a32d => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:34.045407 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] VM Started (Lifecycle Event)
May 14 04:30:34.156929 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:34.324219 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:34.372420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-608c3b18-74ef-4872-b778-0659c2525b01 for instance a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:30:34.379260 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Took 8.06 seconds to spawn the instance on the hypervisor.
May 14 04:30:34.379669 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:34.393236 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:34.393502 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:34.402508 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updated VIF entry in instance network info cache for port 63094e41-ebd7-481f-a17f-8931686f90d7. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:34.402508 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating instance_info_cache with network_info: [{"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:34.550826 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:34.561910 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:34.710919 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:34.712434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:34.712688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:34.712859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:34.713052 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] No waiting events found dispatching network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:34.716566 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-16bf7cc9-a7ce-4e87-b03e-3d889e1ac157 req-4f07b86a-a81c-470d-b647-ef297b8484f6 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received unexpected event network-vif-plugged-7b342f78-e288-4c8c-a6af-10acc55dd024 for instance with vm_state active and task_state None.
May 14 04:30:34.898945 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:34.906800 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Took 15.14 seconds to build instance.
May 14 04:30:34.911539 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9c84de55-f50f-4797-96e6-46d950a6a9f5 req-e43ce372-0cb9-4bd3-87c5-258444895582 service nova] Releasing lock "refresh_cache-be285f62-66b7-4e5c-84a6-077afe0a69fb" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:35.064711 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733035.0643477, 8535c256-4cff-4edb-9e78-23028fb7a32d => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:35.065806 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] VM Paused (Lifecycle Event)
May 14 04:30:35.416578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b56e36d7-f517-48d3-9260-026a15b47b45 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.672s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:35.571549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:35.575373 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733035.5747972, 8535c256-4cff-4edb-9e78-23028fb7a32d => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:35.576151 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] VM Resumed (Lifecycle Event)
May 14 04:30:35.577179 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:30:35.917506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:35.920185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.091s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:35.922414 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.678s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:35.926461 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:35.927005 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Claim successful on node np0000000747
May 14 04:30:36.079363 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:36.082245 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:36.539892 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-changed-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:36.540972 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Refreshing instance network info cache due to event network-changed-7b342f78-e288-4c8c-a6af-10acc55dd024. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:36.541243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] Acquiring lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:36.541401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] Acquired lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:36.541589 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Refreshing network info cache for port 7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:36.585122 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733036.5847375, a7b6e4bf-576f-438e-907f-71fef72b19b5 => ua-608c3b18-74ef-4872-b778-0659c2525b01> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:30:36.590632 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully detached device vdb from instance a7b6e4bf-576f-438e-907f-71fef72b19b5 from the live domain config.
May 14 04:30:36.595420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:30:36.595420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:30:36.595420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:30:36.595420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:30:36.595838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '608c3b18-74ef-4872-b778-0659c2525b01', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:30:36.596052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:30:36.611846 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocation for migration d5e76812-a3f1-408b-95e0-b7496131294c
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:36.648766 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:30:36.649810 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:30:36.649810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '52')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:30:36.651054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01', '51')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:30:36.656514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618389080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:30:36.656905 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:30:36.657036 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Flush multipath device 3300000003573d0e6 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:30:36.693763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:30:36.737857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:30:36.778366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:30:36.778611 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:30:36.780195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:30:36.793394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:30:36.793679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:30:36.810224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.863858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.40.100,3260]
May 14 04:30:36.863858 np0000000747 nova-compute[97971]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.40.100,3260] successful.
May 14 04:30:36.863858 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.900395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.912885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.958008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.50.100,3260]
May 14 04:30:36.958008 np0000000747 nova-compute[97971]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-608c3b18-74ef-4872-b778-0659c2525b01, portal: 192.168.50.100,3260] successful.
May 14 04:30:36.958008 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.987454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:30:36.987454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:30:36.987454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] <== disconnect_volume: return (393ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:30:36.987454 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:30:37.052196 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:37.119969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-00697c7e-f0c5-4de9-8b17-3c365c7152c2 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.660s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:37.570148 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'flavor' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:37.610330 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:37.811711 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updated VIF entry in instance network info cache for port 7b342f78-e288-4c8c-a6af-10acc55dd024. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:37.812350 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating instance_info_cache with network_info: [{"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:37.873228 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:37.873573 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:38.007334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:38.007508 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:38.153935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:38.315230 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-976117ed-f77d-448a-9f4b-628402e9683b req-53fda851-3171-412a-8860-0405a74250d9 service nova] Releasing lock "refresh_cache-8535c256-4cff-4edb-9e78-23028fb7a32d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:38.376123 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:38.509502 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:30:38.589996 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-738b9f43-8718-4514-b36f-4ecaaa0e3d66 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.603s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:38.596683 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:38.596838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing instance network info cache due to event network-changed-79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:38.596997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] Acquiring lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:38.597108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] Acquired lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:38.597219 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Refreshing network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:38.887449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.965s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:38.887976 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:30:39.069325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:39.069325 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:39.073638 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:39.073638 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Claim successful on node np0000000747
May 14 04:30:39.101123 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:39.330868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:39.400700 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:30:39.400700 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:30:39.400700 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:39.400700 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:39.460910 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:39.485930 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b73f8491edc4c59b345fbd4d3b6c6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3030a0d75e9c41828981f529272fd47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:30:39.487273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:39.487705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:39.487952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:39.488123 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:39.488315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:39.490812 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Terminating instance
May 14 04:30:39.635204 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updated VIF entry in instance network info cache for port 79ffd091-d1b4-40f2-a837-e3aea3edff11. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:39.635204 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [{"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:39.906115 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:30:39.995250 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:30:40.026811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.052081 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.132151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b689b10a-c4df-4b2f-bd3c-feeb0c82661e req-7c1466d1-e53b-489c-bd52-0bbc63464b10 service nova] Releasing lock "refresh_cache-3370940d-3bd7-45f3-887f-9c515137a348" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:40.193641 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.199779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.344183 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999630746000093 future=<Future at 0x7435f84570b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:40.346685 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Instance destroyed successfully.
May 14 04:30:40.347118 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid a7b6e4bf-576f-438e-907f-71fef72b19b5 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:40.410178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:30:40.505474 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Successfully created port: d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:30:40.689238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:40.692175 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing instance network info cache due to event network-changed-6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:40.692439 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] Acquiring lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:40.692626 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] Acquired lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:40.692808 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Refreshing network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:40.852966 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1739446664',display_name='tempest-ServerRescueNegativeTestJSON-server-1739446664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1739446664',id=23,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYqv3s463mDZiZNCMV6O57fhNxf2RO2CpxEBkvzL2dkobV1k8FqQgv/RWk0eox7we2ogr+KSmSOxKTRWXSY5Gq3EDTpU7HagD6Mla6dAXMddfk7ZilmxO0oQoGK7Yo5w==',key_name='tempest-keypair-1249813357',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:48Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-0uhmj886',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79086847c5a343519481b0a50930103f',uuid=a7b6e4bf-576f-438e-907f-71fef72b19b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:40.854300 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "address": "fa:16:3e:9c:b8:5b", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bbd018-f0", "ovs_interfaceid": "e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:40.856591 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:40.856834 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:40.858306 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.859947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3bbd018-f0, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:40.859947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.860670 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:40.862258 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.864229 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.864425 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb139b47-138f-4bb4-9207-f3cdb6c3839d) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:40.865263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.865758 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:40.869952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:40.876066 np0000000747 nova-compute[97971]: INFO os_vif [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bbd018-f0')
May 14 04:30:40.876417 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Deleting instance files /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5_del
May 14 04:30:40.877388 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Deletion of /opt/stack/data/nova/instances/a7b6e4bf-576f-438e-907f-71fef72b19b5_del complete
May 14 04:30:40.925190 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:41.051929 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:41.052090 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:41.194671 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Successfully updated port: d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:30:41.197536 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:41.388022 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 04:30:41.389051 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:30:41.389445 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:30:41.389445 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:30:41.389799 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:41.420123 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:41.420684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:41.421093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:41.421299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:41.421590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:41.421920 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-034012ce-0b2b-40a4-a34c-fcd9a4ab05cb req-825ea707-fd0d-475c-9b7a-44598d89c60c service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:41.432645 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:30:41.433287 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:30:41.433287 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Creating image(s)
May 14 04:30:41.433463 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:41.433665 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:41.434119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:41.434717 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:41.437961 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:41.439696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:41.553541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:41.555848 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:41.561214 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:41.566323 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:41.566491 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:41.570289 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:41.570798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:41.600704 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:41.644336 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:41.673260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:41.674868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:41.710936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:41.710936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:41.710936 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:41.735733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk 1073741824" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:41.736355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:41.736917 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:41.848008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:41.879558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.143s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:41.880080 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:41.880326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:41.912979 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updated VIF entry in instance network info cache for port 6b5be577-bb55-41a2-ae2e-178c3bd132cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:41.914057 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [{"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:41.989914 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0013173039999401226 future=<Future at 0x7435f8566ff0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:41.989914 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:41.990385 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.353644397999915 future=<Future at 0x7435f84570b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:41.990385 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.35353602400005 future=<Future at 0x7435f84570b0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:41.993122 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Cannot resize image /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Ensure instance console log exists: /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:41.994900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:42.068133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.999s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:42.069158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:30:42.330313 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:42.418543 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c024c6a8-be39-4a4e-af0e-e7ff0af586ce req-1a7b2fd0-4309-4483-b73b-b16f23b552a6 service nova] Releasing lock "refresh_cache-85a9913c-942d-4796-86b3-dc12a56ee6fd" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:42.558148 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:42.576968 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:30:42.577517 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:30:42.577667 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:42.577870 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:42.725745 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:42.766837 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Updating instance_info_cache with network_info: [{"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:42.769161 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1578caad794741539afe0add8944511a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd5abed60b41de9a0e9b34a5c8d4c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:30:42.786248 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Received event network-changed-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:42.786540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Refreshing instance network info cache due to event network-changed-d10bc415-5b89-44df-a03b-f212a0abcddd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:42.786706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] Acquiring lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:43.082094 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:30:43.232344 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Took 1.84 seconds to deallocate network for instance.
May 14 04:30:43.272272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:43.273411 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Instance network_info: |[{"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:30:43.275863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] Acquired lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:43.276061 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Refreshing network info cache for port d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:43.277458 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Start _get_guest_xml network_info=[{"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:43.281974 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:43.283523 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2137749004', uuid='8860392d-b13e-43fe-9f11-b8800d1ba6fa'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733043.283043) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:43.286479 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:43.287038 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:43.288431 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:43.288741 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:43.290247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:43.290575 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:43.291181 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:43.291537 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:43.291795 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:43.291937 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:43.292085 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:43.292322 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:43.292575 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:43.292699 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:43.293133 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:43.293689 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:43.311033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2137749004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-2137749004',id=33,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-qh6e5lij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:40Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=8860392d-b13e-43fe-9f11-b8800d1ba6fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:43.311301 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:43.312210 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:43.313071 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 8860392d-b13e-43fe-9f11-b8800d1ba6fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:43.522146 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Successfully created port: 032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:30:43.526540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:43.526920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] Acquiring lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:43.527224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:43.527394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:43.527577 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] No waiting events found dispatching network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:43.527728 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-930a9050-0ef6-42d1-8e49-6f31fd01c700 req-eb2d9d4f-95e5-4a0d-bf27-88ed69cfe91d service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received unexpected event network-vif-unplugged-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 for instance with vm_state deleted and task_state None.
May 14 04:30:43.586040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:30:43.740169 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:43.740316 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:43.782274 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:43.818212 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <uuid>8860392d-b13e-43fe-9f11-b8800d1ba6fa</uuid>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <name>instance-00000021</name>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2137749004</nova:name>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:43</nova:creationTime>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         <nova:port uuid="d10bc415-5b89-44df-a03b-f212a0abcddd">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="serial">8860392d-b13e-43fe-9f11-b8800d1ba6fa</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="uuid">8860392d-b13e-43fe-9f11-b8800d1ba6fa</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.config"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ba:fd:2b"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <target dev="tapd10bc415-5b"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/console.log" append="off"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:43.818212 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:43.821170 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Preparing to wait for external event network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:43.821170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:43.821170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:43.821170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:43.822515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2137749004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-2137749004',id=33,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-qh6e5lij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:40Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=8860392d-b13e-43fe-9f11-b8800d1ba6fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:43.822515 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:43.823241 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:43.826095 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:43.826517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:43.827034 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:43.827453 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:43.828763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:43.828975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a52b4e96-717b-50e5-9dec-77b25893fb85', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:43.830492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:43.832605 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:43.837464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:43.839193 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd10bc415-5b, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:43.839702 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd10bc415-5b, col_values=(('qos', UUID('4afa591f-540b-4994-ad7c-620c13c6e126')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:43.839933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd10bc415-5b, col_values=(('external_ids', {'iface-id': 'd10bc415-5b89-44df-a03b-f212a0abcddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:fd:2b', 'vm-uuid': '8860392d-b13e-43fe-9f11-b8800d1ba6fa'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:43.842932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:43.848693 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:43.849688 np0000000747 nova-compute[97971]: INFO os_vif [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b')
May 14 04:30:44.125385 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Successfully updated port: 032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:30:44.236709 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:44.428897 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Updated VIF entry in instance network info cache for port d10bc415-5b89-44df-a03b-f212a0abcddd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:44.429252 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Updating instance_info_cache with network_info: [{"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:44.600171 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:30:44.600171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:30:44.600559 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Creating image(s)
May 14 04:30:44.601110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:44.601450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:44.602031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:44.602981 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:44.607478 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:44.609228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:44.640986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:44.641134 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquired lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:44.641645 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:44.719069 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:44.719850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:44.721672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:44.721672 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:44.729628 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:44.734642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:44.777489 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:44.778091 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:44.838763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:44.842637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:44.912975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk 1073741824" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:44.916632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:44.916632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:44.933727 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] Releasing lock "refresh_cache-8860392d-b13e-43fe-9f11-b8800d1ba6fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:44.934414 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8c0bc31f-945f-4bfa-9e4a-ac2420aed235 req-76db6cf7-5235-4126-8c6a-3ba784042f66 service nova] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Received event network-vif-deleted-e3bbd018-f0b9-4501-8a79-a7ca9ca69bc2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:45.011265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:45.014634 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:45.014634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:45.102077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:45.102899 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Cannot resize image /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:45.103634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:45.104052 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Ensure instance console log exists: /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:45.104525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:45.104947 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:45.105234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:45.272043 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:45.283409 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:45.307637 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:45.375265 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:45.375394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:45.375483 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:ba:fd:2b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:45.376188 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Using config drive
May 14 04:30:45.493125 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:45.605913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-changed-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:45.606244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Refreshing instance network info cache due to event network-changed-032848f8-bb50-4762-9e2f-c3f7fb231794. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:45.606427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] Acquiring lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:45.685004 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Updating instance_info_cache with network_info: [{"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:45.796436 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.056s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:45.868298 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Deleted allocations for instance a7b6e4bf-576f-438e-907f-71fef72b19b5
May 14 04:30:45.884285 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:45.926530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.172232 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Creating config drive at /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.config
May 14 04:30:46.176941 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqekm0bah {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:46.192408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Releasing lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:46.196675 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Instance network_info: |[{"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:30:46.197499 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] Acquired lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:46.197786 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Refreshing network info cache for port 032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:46.205444 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Start _get_guest_xml network_info=[{"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:30:46.217153 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:30:46.219630 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-164961024', uuid='c83f1eb6-8fdf-4986-8264-33870c021e33'), owner=OwnerMeta(userid='1578caad794741539afe0add8944511a', username='tempest-VolumesNegativeTest-66206547-project-member', projectid='acfd5abed60b41de9a0e9b34a5c8d4c5', projectname='tempest-VolumesNegativeTest-66206547'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733046.2189498) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:30:46.228086 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:30:46.228086 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:30:46.229206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:30:46.229474 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:30:46.230926 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:30:46.231384 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:30:46.231627 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:30:46.231782 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:30:46.232832 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:30:46.232832 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:30:46.232832 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:30:46.233115 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:30:46.233115 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:30:46.233239 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:30:46.233416 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:30:46.233592 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:30:46.248972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-164961024',display_name='tempest-VolumesNegativeTest-instance-164961024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesnegativetest-instance-164961024',id=34,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acfd5abed60b41de9a0e9b34a5c8d4c5',ramdisk_id='',reservation_id='r-pe0yfw92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-66206547',owner_user_name='tempest-VolumesNegativeTest-66206547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:44Z,user_data=None,user_id='1578caad794741539afe0add8944511a',uuid=c83f1eb6-8fdf-4986-8264-33870c021e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:30:46.249331 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converting VIF {"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:46.250114 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:46.250971 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lazy-loading 'pci_devices' on Instance uuid c83f1eb6-8fdf-4986-8264-33870c021e33 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:46.258356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqekm0bah" returned: 0 in 0.081s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:46.710790 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:46.756722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] End _get_guest_xml xml=<domain type="qemu">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <uuid>c83f1eb6-8fdf-4986-8264-33870c021e33</uuid>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <name>instance-00000022</name>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesNegativeTest-instance-164961024</nova:name>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:30:46</nova:creationTime>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:user uuid="1578caad794741539afe0add8944511a">tempest-VolumesNegativeTest-66206547-project-member</nova:user>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:project uuid="acfd5abed60b41de9a0e9b34a5c8d4c5">tempest-VolumesNegativeTest-66206547</nova:project>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         <nova:port uuid="032848f8-bb50-4762-9e2f-c3f7fb231794">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="192.168.233.46" ipVersion="4"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <system>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="serial">c83f1eb6-8fdf-4986-8264-33870c021e33</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="uuid">c83f1eb6-8fdf-4986-8264-33870c021e33</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </system>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <os>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </os>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <features>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </features>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   <devices>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.config"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </disk>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:86:5f:5e"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <target dev="tap032848f8-bb"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </interface>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/console.log" append="off"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </serial>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <video>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </video>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </rng>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:   </devices>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]: </domain>
May 14 04:30:46.756722 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Preparing to wait for external event network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-164961024',display_name='tempest-VolumesNegativeTest-instance-164961024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesnegativetest-instance-164961024',id=34,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acfd5abed60b41de9a0e9b34a5c8d4c5',ramdisk_id='',reservation_id='r-pe0yfw92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-66206547',owner_user_name='tempest-VolumesNegativeTest-66206547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:44Z,user_data=None,user_id='1578caad794741539afe0add8944511a',uuid=c83f1eb6-8fdf-4986-8264-33870c021e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converting VIF {"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:46.761789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:30:46.763252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.763454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a738c15-b750-580b-b97b-41f2b82e3f4c', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:46.764188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.764893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:46.772393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.774539 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.774761 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap032848f8-bb, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:46.775112 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap032848f8-bb, col_values=(('qos', UUID('c2f1134e-0516-4bcb-92da-f578f85222f5')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:46.775299 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap032848f8-bb, col_values=(('external_ids', {'iface-id': '032848f8-bb50-4762-9e2f-c3f7fb231794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:5f:5e', 'vm-uuid': 'c83f1eb6-8fdf-4986-8264-33870c021e33'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:46.776264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.778278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:46.792864 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.797270 np0000000747 nova-compute[97971]: INFO os_vif [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb')
May 14 04:30:46.814130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.859465 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.860695 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.883276 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9b769fd-7353-4d4c-ae4b-b034376a9281 tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "a7b6e4bf-576f-438e-907f-71fef72b19b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.396s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:46.964894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.983957 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:46.992700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:47.158360 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:47.477243 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:47.586708 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Updated VIF entry in instance network info cache for port 032848f8-bb50-4762-9e2f-c3f7fb231794. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:30:47.586916 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Updating instance_info_cache with network_info: [{"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:47.837927 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733047.8375068, 8860392d-b13e-43fe-9f11-b8800d1ba6fa => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:47.838281 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] VM Started (Lifecycle Event)
May 14 04:30:48.089422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94d35493-89d4-4aed-988a-c5670953f87c req-f18c9603-d41f-4832-97e4-b3bf1b85b860 service nova] Releasing lock "refresh_cache-c83f1eb6-8fdf-4986-8264-33870c021e33" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:48.283671 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be256633-adeb-434e-88bf-d90927058907 req-dbc56c8c-90aa-4682-b601-eab6d47bb0b4 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Received event network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:48.283671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be256633-adeb-434e-88bf-d90927058907 req-dbc56c8c-90aa-4682-b601-eab6d47bb0b4 service nova] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:48.283671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be256633-adeb-434e-88bf-d90927058907 req-dbc56c8c-90aa-4682-b601-eab6d47bb0b4 service nova] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:48.283671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be256633-adeb-434e-88bf-d90927058907 req-dbc56c8c-90aa-4682-b601-eab6d47bb0b4 service nova] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:48.283671 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be256633-adeb-434e-88bf-d90927058907 req-dbc56c8c-90aa-4682-b601-eab6d47bb0b4 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Processing event network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:48.283972 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:48.289445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:48.294123 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Instance spawned successfully.
May 14 04:30:48.294715 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:48.323082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:48.323082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:30:48.323082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] No VIF found with MAC fa:16:3e:86:5f:5e, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:30:48.323082 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Using config drive
May 14 04:30:48.340295 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:48.347890 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:48.801634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.801850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.802263 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.802540 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.802871 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.803288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:48.843090 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:48.853814 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:30:48.853949 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733048.8535469, 8860392d-b13e-43fe-9f11-b8800d1ba6fa => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:48.855694 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] VM Paused (Lifecycle Event)
May 14 04:30:49.012933 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Creating config drive at /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.config
May 14 04:30:49.016857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpivrnvvhh {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:49.087522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpivrnvvhh" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:49.310383 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Took 7.88 seconds to spawn the instance on the hypervisor.
May 14 04:30:49.314920 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:49.360109 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:49.367651 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733049.3663886, 8860392d-b13e-43fe-9f11-b8800d1ba6fa => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:49.367651 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] VM Resumed (Lifecycle Event)
May 14 04:30:49.631015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:49.704371 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:49.709568 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:49.717735 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:49.773145 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:49.832554 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Took 16.67 seconds to build instance.
May 14 04:30:49.871892 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:49.877329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:50.035279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:50.039370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:50.042740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:50.071935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:50.074966 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:50.339118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:50.376242 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Received event network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:50.376914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:50.377137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:50.377261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:50.377428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] No waiting events found dispatching network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:50.377592 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8989247a-e21b-4c34-8a5f-e9d603becf51 req-d91b3c3a-e7b6-45c0-9109-a5c05af45aa6 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Received unexpected event network-vif-plugged-d10bc415-5b89-44df-a03b-f212a0abcddd for instance with vm_state active and task_state None.
May 14 04:30:50.682349 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733050.681642, c83f1eb6-8fdf-4986-8264-33870c021e33 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:50.682349 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] VM Started (Lifecycle Event)
May 14 04:30:50.931660 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.080203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:51.080359 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:51.080536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:51.080656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:51.080836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:51.083133 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Terminating instance
May 14 04:30:51.091965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:51.092158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:51.186324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:51.189087 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733051.1883178, c83f1eb6-8fdf-4986-8264-33870c021e33 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:51.189293 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] VM Paused (Lifecycle Event)
May 14 04:30:51.594256 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:30:51.594511 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:30:51.625877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.632154 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.663795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.693248 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:51.699062 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:51.776657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.784648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.791010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:51.960640 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Instance destroyed successfully.
May 14 04:30:51.960640 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:51.968611 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:52.152344 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:52.152596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:52.156762 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:30:52.156941 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Claim successful on node np0000000747
May 14 04:30:52.204954 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:30:52.205386 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999771832000079 future=<Future at 0x7435f84c7170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:52.440032 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Acquiring lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] No waiting events found dispatching network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:52.444733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-282d79f4-d213-4c55-870f-600aff5d8494 req-b0ee54a8-98cf-49da-8e24-e39404c0d3ca service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-unplugged-caa81c2c-9fc5-4954-aedd-1d66a1260c92 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:52.461944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728986131',display_name='tempest-ServerRescueNegativeTestJSON-server-728986131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-728986131',id=19,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:58Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-56ihvza1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:59Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=26b8a48c-e7dd-4ac7-a362-1ef4ef56360a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:52.462171 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "address": "fa:16:3e:9c:6b:d0", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa81c2c-9f", "ovs_interfaceid": "caa81c2c-9fc5-4954-aedd-1d66a1260c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:52.462963 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:52.463241 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:52.465123 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.465338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaa81c2c-9f, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:52.466472 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.467688 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:52.468785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.470020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.470185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a58377b-7020-4980-bf71-3797896a690b) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:52.470730 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.471631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:52.472497 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:52.475567 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] instance snapshotting
May 14 04:30:52.477227 np0000000747 nova-compute[97971]: INFO os_vif [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:6b:d0,bridge_name='br-int',has_traffic_filtering=True,id=caa81c2c-9fc5-4954-aedd-1d66a1260c92,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa81c2c-9f')
May 14 04:30:52.477663 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Deleting instance files /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a_del
May 14 04:30:52.478924 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Deletion of /opt/stack/data/nova/instances/26b8a48c-e7dd-4ac7-a362-1ef4ef56360a_del complete
May 14 04:30:52.572815 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Beginning live snapshot process
May 14 04:30:52.812735 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-121fa2a0-32d7-4a97-8e09-e5dba6048f3c req-d4801884-b795-4cfe-9a04-8cc9c520edb0 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:52.814928 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121fa2a0-32d7-4a97-8e09-e5dba6048f3c req-d4801884-b795-4cfe-9a04-8cc9c520edb0 service nova] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:52.815242 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121fa2a0-32d7-4a97-8e09-e5dba6048f3c req-d4801884-b795-4cfe-9a04-8cc9c520edb0 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:52.815874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-121fa2a0-32d7-4a97-8e09-e5dba6048f3c req-d4801884-b795-4cfe-9a04-8cc9c520edb0 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:52.816396 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-121fa2a0-32d7-4a97-8e09-e5dba6048f3c req-d4801884-b795-4cfe-9a04-8cc9c520edb0 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Processing event network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:30:52.816777 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:30:52.820292 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733052.8197553, c83f1eb6-8fdf-4986-8264-33870c021e33 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:52.821105 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:30:52.821794 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] VM Resumed (Lifecycle Event)
May 14 04:30:52.824408 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Instance spawned successfully.
May 14 04:30:52.824902 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:30:52.988397 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 04:30:52.989491 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:30:52.989846 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:30:52.990026 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:30:52.990345 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:53.135047 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:53.327785 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:53.334195 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:30:53.339048 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.339311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.343169 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.343169 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.343459 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.345691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:30:53.502924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9291451c-e5f3-41bb-9993-48f2c9bac81c req-cbd4d1a2-77f2-46ab-8dc3-7bed34504ce2 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Received event network-vif-deleted-caa81c2c-9fc5-4954-aedd-1d66a1260c92 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:53.503571 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-9291451c-e5f3-41bb-9993-48f2c9bac81c req-cbd4d1a2-77f2-46ab-8dc3-7bed34504ce2 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Neutron deleted interface caa81c2c-9fc5-4954-aedd-1d66a1260c92; detaching it from the instance and deleting it from the info cache
May 14 04:30:53.503800 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9291451c-e5f3-41bb-9993-48f2c9bac81c req-cbd4d1a2-77f2-46ab-8dc3-7bed34504ce2 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:53.834922 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:30:53.853065 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Took 9.25 seconds to spawn the instance on the hypervisor.
May 14 04:30:53.853065 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:53.925202 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:54.010377 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9291451c-e5f3-41bb-9993-48f2c9bac81c req-cbd4d1a2-77f2-46ab-8dc3-7bed34504ce2 service nova] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Detach interface failed, port_id=caa81c2c-9fc5-4954-aedd-1d66a1260c92, reason: Instance 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:30:54.088317 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:54.134171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:54.134476 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:54.180599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:54.181074 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:54.270011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:54.271073 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:54.275224 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:54.275690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:54.368836 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Took 15.35 seconds to build instance.
May 14 04:30:54.369114 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:54.369782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9.delta 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:54.432536 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Took 1.44 seconds to deallocate network for instance.
May 14 04:30:54.435681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9.delta 1073741824" returned: 0 in 0.066s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:54.436631 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 04:30:54.639078 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:54.752589 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:30:54.754958 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 04:30:54.808055 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:30:54.808322 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9.delta /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:54.897704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.888s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:54.902214 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:54.902557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:54.902864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:54.903030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:54.903214 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] No waiting events found dispatching network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:54.903409 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e8b05f73-0f07-4055-b8ad-eb7da02b5d9a req-d06a11e5-21ba-434b-ad1c-597c8ba64dc8 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received unexpected event network-vif-plugged-032848f8-bb50-4762-9e2f-c3f7fb231794 for instance with vm_state active and task_state None.
May 14 04:30:54.936909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9.delta /opt/stack/data/nova/instances/snapshots/tmp9f3v42hh/da9aca74a1a04acbb5438b4571cbcca9" returned: 0 in 0.128s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:54.937484 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Snapshot extracted, beginning image upload
May 14 04:30:54.944079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:55.149009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.996s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:55.149862 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.205s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:55.150107 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:30:55.344327 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00048641400007909397 future=<Future at 0x7435f84570b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:55.345452 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:55.345773 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] Emitting event <LifecycleEvent: 1778733040.343687, a7b6e4bf-576f-438e-907f-71fef72b19b5 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:30:55.346053 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=11.859102019000147 future=<Future at 0x7435f84c7170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:55.346386 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] VM Stopped (Lifecycle Event)
May 14 04:30:55.347737 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=11.857440226000108 future=<Future at 0x7435f84c7170 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:55.549860 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:55.550085 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:55.550311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:55.550647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:55.550647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:55.554180 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Terminating instance
May 14 04:30:55.657670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:30:55.658120 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:30:55.658521 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:55.658917 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:55.767722 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c70081f7fcd749669ada222e6be6e8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8b3bba7862432eb957054a0284982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:30:55.850568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c9071ef6-7edc-4a27-807c-fd8671e57542 tempest-ServersNegativeTestJSON-1703914415 tempest-ServersNegativeTestJSON-1703914415-project-member] [instance: a7b6e4bf-576f-438e-907f-71fef72b19b5] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:30:55.935998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.061066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:30:56.096833 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.104583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.127305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:30:56.127305 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:30:56.133829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.161944 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:30:56.167272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.420459 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999649171000101 future=<Future at 0x7435f823ba40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:56.425271 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Instance destroyed successfully.
May 14 04:30:56.426011 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lazy-loading 'resources' on Instance uuid c83f1eb6-8fdf-4986-8264-33870c021e33 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:56.630011 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:30:56.668208 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Successfully created port: 3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:30:56.671372 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:30:56.932365 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-164961024',display_name='tempest-VolumesNegativeTest-instance-164961024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesnegativetest-instance-164961024',id=34,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:53Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acfd5abed60b41de9a0e9b34a5c8d4c5',ramdisk_id='',reservation_id='r-pe0yfw92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-66206547',owner_user_name='tempest-VolumesNegativeTest-66206547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:54Z,user_data=None,user_id='1578caad794741539afe0add8944511a',uuid=c83f1eb6-8fdf-4986-8264-33870c021e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:56.932365 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converting VIF {"id": "032848f8-bb50-4762-9e2f-c3f7fb231794", "address": "fa:16:3e:86:5f:5e", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032848f8-bb", "ovs_interfaceid": "032848f8-bb50-4762-9e2f-c3f7fb231794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:56.932365 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:56.932365 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:56.934635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.935076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap032848f8-bb, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:56.937158 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.937979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:56.939131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.940606 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.941238 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2f1134e-0516-4bcb-92da-f578f85222f5) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:56.942203 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.942454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:56.944147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:56.946865 np0000000747 nova-compute[97971]: INFO os_vif [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5f:5e,bridge_name='br-int',has_traffic_filtering=True,id=032848f8-bb50-4762-9e2f-c3f7fb231794,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032848f8-bb')
May 14 04:30:56.947252 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Deleting instance files /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33_del
May 14 04:30:56.948651 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Deletion of /opt/stack/data/nova/instances/c83f1eb6-8fdf-4986-8264-33870c021e33_del complete
May 14 04:30:56.980066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:56.980437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:56.980599 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:56.980876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:56.980876 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] No waiting events found dispatching network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:56.981083 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:56.981168 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:56.981243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Acquiring lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:56.981367 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:56.981555 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:56.981657 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] No waiting events found dispatching network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:56.981736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20c77be7-e849-42bb-8f93-a2dfaf9ce71b req-6062cd21-18df-448e-bc95-6b5467bde8e5 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-unplugged-032848f8-bb50-4762-9e2f-c3f7fb231794 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:57.141026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.992s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:57.212218 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Deleted allocations for instance 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a
May 14 04:30:57.289862 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Successfully updated port: 3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:30:57.354644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:57.355052 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing instance network info cache due to event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:30:57.355255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] Acquiring lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:57.355351 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] Acquired lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:57.355493 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing network info cache for port 3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:30:57.457509 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:30:57.458360 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:30:57.458598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:30:57.458792 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:30:57.459105 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:57.625837 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:57.682109 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:30:57.683271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:30:57.683563 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Creating image(s)
May 14 04:30:57.684266 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:57.684450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:57.685033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:57.685604 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:57.689552 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:57.691864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:57.796386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:30:57.806761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:57.807567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:57.808196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:57.809190 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:57.814326 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:30:57.814923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:57.859984 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:57.946651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:57.947956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:58.025200 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:58.057771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk 1073741824" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:58.058192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:58.058776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:58.164387 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:58.165004 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:30:58.165262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:30:58.230010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ec77bcf5-c672-4f53-80a9-6b3e5eb373fe tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "26b8a48c-e7dd-4ac7-a362-1ef4ef56360a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.149s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:58.274912 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:30:58.274912 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Cannot resize image /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:30:58.274912 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:30:58.275288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Ensure instance console log exists: /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:30:58.276258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:58.276258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:58.276258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:58.294270 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:58.335652 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Snapshot image upload complete
May 14 04:30:58.335921 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-83700845-8502-4095-b996-1df173367349 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Took 5.86 seconds to snapshot the instance on the hypervisor.
May 14 04:30:58.525739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:58.525902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:58.526142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:58.526271 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:58.526382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:58.529850 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Terminating instance
May 14 04:30:58.797500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a89b437-7189-4075-a98a-76004ace0601 req-195e063c-c8cd-4c57-a446-d20a1f5b7762 service nova] Releasing lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:30:58.798036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquired lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:30:58.798250 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:30:58.981141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:58.981141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:58.983166 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:59.033416 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:30:59.065161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.069135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.095629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.097296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.122399 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.123996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.242564 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:59.246032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:59.246267 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:30:59.246466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:30:59.246630 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:30:59.246825 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-83a740e0-f3bb-4fd8-8312-9f00fa9f029b req-e68571fa-63e2-47cb-ace1-3ff871363a20 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:30:59.382749 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99960983799997 future=<Future at 0x7435f82505c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:30:59.384691 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Instance destroyed successfully.
May 14 04:30:59.385382 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lazy-loading 'resources' on Instance uuid 09eb687f-f8dd-4062-b883-f2211b86533e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:30:59.410691 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:30:59.427166 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2c5561ce-6616-4d45-a053-142d2095aaed req-4b28e0cb-3df3-4fc0-b50a-7ab396d3db78 service nova] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Received event network-vif-deleted-032848f8-bb50-4762-9e2f-c3f7fb231794 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:30:59.483561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Detaching volume f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:30:59.485370 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Took 2.03 seconds to deallocate network for instance.
May 14 04:30:59.553033 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Attempting to driver detach volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 from mountpoint /dev/vdb
May 14 04:30:59.559594 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:30:59.562261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:30:59.562261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Attempting to detach device vdb from instance 3370940d-3bd7-45f3-887f-9c515137a348 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:30:59.562261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]: </disk>
May 14 04:30:59.562261 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:30:59.568198 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 3370940d-3bd7-45f3-887f-9c515137a348 from the persistent domain config.
May 14 04:30:59.568982 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] (1/8): Attempting to detach device vdb with device alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 from instance 3370940d-3bd7-45f3-887f-9c515137a348 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:30:59.568982 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]: </disk>
May 14 04:30:59.568982 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:30:59.608085 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:30:59.778813 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating instance_info_cache with network_info: [{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:30:59.889466 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881911355',display_name='tempest-ServerRescueNegativeTestJSON-server-1881911355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverrescuenegativetestjson-server-1881911355',id=18,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:28:13Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfaef82fed39403a80c7ec4baa8ad091',ramdisk_id='',reservation_id='r-fu68neib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1810790550',owner_user_name='tempest-ServerRescueNegativeTestJSON-1810790550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:28:21Z,user_data=None,user_id='79086847c5a343519481b0a50930103f',uuid=09eb687f-f8dd-4062-b883-f2211b86533e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:30:59.889721 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converting VIF {"id": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "address": "fa:16:3e:0b:98:cf", "network": {"id": "0e661db7-a1da-4eb2-aad8-98970c280592", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1211752412-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cfaef82fed39403a80c7ec4baa8ad091", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b6dc47-4e", "ovs_interfaceid": "f9b6dc47-4e62-4b75-845e-2b20f0e068fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:30:59.890508 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:30:59.890832 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:30:59.892843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.893213 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9b6dc47-4e, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:59.894444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.894955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:59.896375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.898027 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.898212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63a79e48-2875-49e0-8f89-72409d3162b6) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:30:59.898851 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.899455 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:30:59.900742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:30:59.902874 np0000000747 nova-compute[97971]: INFO os_vif [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:cf,bridge_name='br-int',has_traffic_filtering=True,id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb,network=Network(0e661db7-a1da-4eb2-aad8-98970c280592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b6dc47-4e')
May 14 04:30:59.903284 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Deleting instance files /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e_del
May 14 04:30:59.904205 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Deletion of /opt/stack/data/nova/instances/09eb687f-f8dd-4062-b883-f2211b86533e_del complete
May 14 04:30:59.995989 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:30:59.996233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:00.220774 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733060.2202892, 3370940d-3bd7-45f3-887f-9c515137a348 => ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:31:00.222044 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 for instance 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:31:00.224667 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 3370940d-3bd7-45f3-887f-9c515137a348 from the live domain config.
May 14 04:31:00.282159 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Releasing lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:00.282696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance network_info: |[{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:00.284078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Start _get_guest_xml network_info=[{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:00.289036 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:00.290634 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1477337880', uuid='5c037683-9726-4c1e-b4eb-d41e0155d9fa'), owner=OwnerMeta(userid='c70081f7fcd749669ada222e6be6e8a1', username='tempest-TestStampPattern-1110078540-project-member', projectid='cf8b3bba7862432eb957054a0284982b', projectname='tempest-TestStampPattern-1110078540'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733060.2900574) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:00.291964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:00.293974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:00.293974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:00.293974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:00.294954 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:00.295288 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:00.295482 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:00.295746 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:00.297698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:00.311728 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477337880',display_name='tempest-TestStampPattern-server-1477337880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1477337880',id=35,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-8a07gwn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:57Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=5c037683-9726-4c1e-b4eb-d41e0155d9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:00.311728 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:00.311728 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:00.312188 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:00.410503 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 04:31:00.411202 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:00.411334 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:00.411430 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:00.411711 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:00.509107 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:00.778127 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Detected multiple connections on this host for volume: f4c52872-aa09-405c-a76c-6fe1f7b26e53, skipping target disconnect.
May 14 04:31:00.817202 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <uuid>5c037683-9726-4c1e-b4eb-d41e0155d9fa</uuid>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <name>instance-00000023</name>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestStampPattern-server-1477337880</nova:name>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:00</nova:creationTime>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:user uuid="c70081f7fcd749669ada222e6be6e8a1">tempest-TestStampPattern-1110078540-project-member</nova:user>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:project uuid="cf8b3bba7862432eb957054a0284982b">tempest-TestStampPattern-1110078540</nova:project>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         <nova:port uuid="3cfc2bdd-ad33-47f0-9950-128e706633e2">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="serial">5c037683-9726-4c1e-b4eb-d41e0155d9fa</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="uuid">5c037683-9726-4c1e-b4eb-d41e0155d9fa</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.config"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:10:87:3a"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <target dev="tap3cfc2bdd-ad"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/console.log" append="off"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:00.817202 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Preparing to wait for external event network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477337880',display_name='tempest-TestStampPattern-server-1477337880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1477337880',id=35,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-8a07gwn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:30:57Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=5c037683-9726-4c1e-b4eb-d41e0155d9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:00.824578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.825208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f09413c7-31c1-5505-9f28-c3ffee1a0707', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:00.826997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.829852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:00.839571 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.839913 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cfc2bdd-ad, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:00.840349 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cfc2bdd-ad, col_values=(('qos', UUID('882e7959-d62e-42de-9e7b-b3d512bc361f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:00.840532 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cfc2bdd-ad, col_values=(('external_ids', {'iface-id': '3cfc2bdd-ad33-47f0-9950-128e706633e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:87:3a', 'vm-uuid': '5c037683-9726-4c1e-b4eb-d41e0155d9fa'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:00.850445 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:00.854233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.860303 np0000000747 nova-compute[97971]: INFO os_vif [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad')
May 14 04:31:00.937017 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:00.972177 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3822738b-3a60-4d8a-9e27-3b37f0fb9110 req-539af746-48d1-4fe3-a11d-fe424936a55f service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-deleted-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:00.972600 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-3822738b-3a60-4d8a-9e27-3b37f0fb9110 req-539af746-48d1-4fe3-a11d-fe424936a55f service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Neutron deleted interface f9b6dc47-4e62-4b75-845e-2b20f0e068fb; detaching it from the instance and deleting it from the info cache
May 14 04:31:00.972800 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3822738b-3a60-4d8a-9e27-3b37f0fb9110 req-539af746-48d1-4fe3-a11d-fe424936a55f service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:01.001907 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:01.002188 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:01.026949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:01.027444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] Acquiring lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] Lock "09eb687f-f8dd-4062-b883-f2211b86533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] No waiting events found dispatching network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:01.326043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-949e3468-40ca-4e9f-86dc-6f291e0e4118 req-fdc4f1e7-1cad-46eb-9283-835598fb8963 service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Received event network-vif-unplugged-f9b6dc47-4e62-4b75-845e-2b20f0e068fb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:01.369057 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:01.383636 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:01.478635 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3822738b-3a60-4d8a-9e27-3b37f0fb9110 req-539af746-48d1-4fe3-a11d-fe424936a55f service nova] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Detach interface failed, port_id=f9b6dc47-4e62-4b75-845e-2b20f0e068fb, reason: Instance 09eb687f-f8dd-4062-b883-f2211b86533e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:01.505837 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:01.530263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:31:01.888178 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Took 1.48 seconds to deallocate network for instance.
May 14 04:31:02.015113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.019s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:02.081668 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Deleted allocations for instance c83f1eb6-8fdf-4986-8264-33870c021e33
May 14 04:31:02.099167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:02.099370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:02.102704 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:31:02.102857 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Claim successful on node np0000000747
May 14 04:31:02.340115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:02.340593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:02.375775 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-53f4cf37-a121-45fe-96dd-24f3ff75e63e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.395s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:02.389060 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:02.389337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:02.389760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No VIF found with MAC fa:16:3e:10:87:3a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:02.390512 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Using config drive
May 14 04:31:02.398082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:02.843364 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Detaching volume f4c52872-aa09-405c-a76c-6fe1f7b26e53
May 14 04:31:02.905186 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:02.907918 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Attempting to driver detach volume f4c52872-aa09-405c-a76c-6fe1f7b26e53 from mountpoint /dev/vdb
May 14 04:31:02.917261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:31:02.918479 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found disk vdb by alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:31:02.918709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Attempting to detach device vdb from instance 85a9913c-942d-4796-86b3-dc12a56ee6fd from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:31:02.918956 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:02.918956 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:31:02.926227 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 85a9913c-942d-4796-86b3-dc12a56ee6fd from the persistent domain config.
May 14 04:31:02.926439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] (1/8): Attempting to detach device vdb with device alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 from instance 85a9913c-942d-4796-86b3-dc12a56ee6fd from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:31:02.926779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <alias name="ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53"/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <serial>f4c52872-aa09-405c-a76c-6fe1f7b26e53</serial>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:02.926779 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:31:03.057056 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Creating config drive at /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.config
May 14 04:31:03.061819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds6eculs {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:03.105145 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-98512896-de87-4dd2-a3e1-51e42e68dea2 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Lock "c83f1eb6-8fdf-4986-8264-33870c021e33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.554s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:03.141248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds6eculs" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:03.708503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:03.757288 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:03.762841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:03.865962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:04.055331 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7434404-d4b9-4131-be6b-ad709c823dba req-75318126-d064-4b9b-8237-dc819510fcf7 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:04.055587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7434404-d4b9-4131-be6b-ad709c823dba req-75318126-d064-4b9b-8237-dc819510fcf7 service nova] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:04.055822 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7434404-d4b9-4131-be6b-ad709c823dba req-75318126-d064-4b9b-8237-dc819510fcf7 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:04.055980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7434404-d4b9-4131-be6b-ad709c823dba req-75318126-d064-4b9b-8237-dc819510fcf7 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:04.056121 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7434404-d4b9-4131-be6b-ad709c823dba req-75318126-d064-4b9b-8237-dc819510fcf7 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Processing event network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:04.065384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:04.065533 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:04.167321 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:04.170275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:04.175235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:04.203272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:04.568921 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:04.743483 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:04.745379 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733064.744146, 5c037683-9726-4c1e-b4eb-d41e0155d9fa => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:04.745379 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] VM Started (Lifecycle Event)
May 14 04:31:04.747040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:04.749500 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance spawned successfully.
May 14 04:31:04.749952 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:05.076397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.977s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:05.078170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.679s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:05.078170 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:31:05.257649 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:05.266041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.266041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.266378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.266609 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.275300 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.275300 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:05.281272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:05.586560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:31:05.586921 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:31:05.587581 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:05.588302 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:05.696277 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b73f8491edc4c59b345fbd4d3b6c6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3030a0d75e9c41828981f529272fd47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:31:05.778262 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Took 8.10 seconds to spawn the instance on the hypervisor.
May 14 04:31:05.778262 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:05.780695 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:05.780972 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733065.7806606, 5c037683-9726-4c1e-b4eb-d41e0155d9fa => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:05.781043 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] VM Paused (Lifecycle Event)
May 14 04:31:05.844867 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:05.939603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:06.010349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:06.011300 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:06.097753 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:31:06.173547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:06.173806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:06.174022 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:06.174177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:06.174712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] No waiting events found dispatching network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:06.174934 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f6f8b0ba-d94f-4787-8ec7-0fad9c74a124 req-28143220-89f9-48b3-8346-9a0add2e967e service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received unexpected event network-vif-plugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 for instance with vm_state active and task_state None.
May 14 04:31:06.252543 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Successfully created port: aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:31:06.283797 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:06.289073 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733066.2887545, 5c037683-9726-4c1e-b4eb-d41e0155d9fa => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:06.289749 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] VM Resumed (Lifecycle Event)
May 14 04:31:06.293030 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Took 14.19 seconds to build instance.
May 14 04:31:06.340455 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53 for instance 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:31:06.513304 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:06.599590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:31:06.794885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.702s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:06.796080 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:06.803514 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:06.862444 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Successfully updated port: aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:31:06.926284 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-changed-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:06.928314 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Refreshing instance network info cache due to event network-changed-aab5398f-df66-42f8-a56f-30a6adccb675. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:06.928314 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] Acquiring lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:06.928428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] Acquired lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:06.928557 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Refreshing network info cache for port aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:07.019370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.943s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:07.081855 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Deleted allocations for instance 09eb687f-f8dd-4062-b883-f2211b86533e
May 14 04:31:07.103888 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Booting with volume-backed-image 61ff7b79-8a72-479d-a718-78041e1efa4d at /dev/vda
May 14 04:31:07.206221 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005761200000051758 future=<Future at 0x7435f84c7170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:07.206221 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:07.206304 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.213787624000133 future=<Future at 0x7435f823ba40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:07.206411 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.213665755000193 future=<Future at 0x7435f823ba40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:07.206780 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Emitting event <LifecycleEvent: 1778733052.2050614, 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:07.206925 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] VM Stopped (Lifecycle Event)
May 14 04:31:07.308287 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733067.3079145, 85a9913c-942d-4796-86b3-dc12a56ee6fd => ua-f4c52872-aa09-405c-a76c-6fe1f7b26e53> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:31:07.316484 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully detached device vdb from instance 85a9913c-942d-4796-86b3-dc12a56ee6fd from the live domain config.
May 14 04:31:07.354869 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:07.354869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:07.354869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:07.356876 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:07.358295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4c52872-aa09-405c-a76c-6fe1f7b26e53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:07.358729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:07.364850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:07.406292 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:07.406292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '47')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:07.409594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53', '48')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:07.410702 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b8040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:07.411292 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:07.411549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flush multipath device 3300000000ad49717 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:07.431843 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:07.458508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:07.514203 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:07.555686 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:07.573257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:07.573516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:07.580188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:07.610989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:07.610989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:07.642229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.692732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.40.100,3260]
May 14 04:31:07.692732 np0000000747 nova-compute[97971]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.40.100,3260] successful.
May 14 04:31:07.692732 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.713513 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: 26b8a48c-e7dd-4ac7-a362-1ef4ef56360a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:07.724057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.744440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.791801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.50.100,3260]
May 14 04:31:07.791801 np0000000747 nova-compute[97971]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-f4c52872-aa09-405c-a76c-6fe1f7b26e53, portal: 192.168.50.100,3260] successful.
May 14 04:31:07.791801 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.823018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:07.823018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:07.823018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== disconnect_volume: return (467ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:07.823018 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:07.848202 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:08.095851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c3f6ba65-3e71-4cec-8f18-6c53e6e8f76d tempest-ServerRescueNegativeTestJSON-1810790550 tempest-ServerRescueNegativeTestJSON-1810790550-project-member] Lock "09eb687f-f8dd-4062-b883-f2211b86533e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.570s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:08.351511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb377610-3cff-45a5-92d8-b2f2276a9380 req-97ca4aae-471a-4353-bdce-d2760f6c9da1 service nova] Releasing lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:08.351855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:08.352071 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:08.407690 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'flavor' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:08.959133 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:09.034821 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:09.037217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing instance network info cache due to event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:09.037385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] Acquiring lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:09.037456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] Acquired lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:09.037572 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing network info cache for port 3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:09.205937 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:09.405522 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:09.419282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c1a8093-234f-4f63-b11f-35f41b396296 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.079s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:09.542285 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:09.556333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:09.556507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:09.911255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:09.911473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance network_info: |[{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:10.024274 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:10.062908 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:10.135043 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:10.238717 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updated VIF entry in instance network info cache for port 3cfc2bdd-ad33-47f0-9950-128e706633e2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:31:10.239055 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating instance_info_cache with network_info: [{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:10.572458 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Ignoring supplied device name: /dev/vdb
May 14 04:31:10.741352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c6fb65b5-c2b3-4e15-b2ea-aa9d71a0e67a req-4c5815a5-e2f2-425c-b339-231d50baa64c service nova] Releasing lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:10.846728 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:10.943750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:11.000669 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:11.016816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:11.046824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:11.078413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:11.098986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:11.099808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:11.112227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:11.116003 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe79:5006', 'fe80::c83e:eaff:fe1a:2a01', 'fe80::fc16:3eff:febd:6c6', 'fe80::fc16:3eff:fe8a:34ca', 'fe80::fc16:3eff:fe1d:1c50', 'fe80::fc16:3eff:fedb:7d33', 'fe80::fc16:3eff:fe47:4942', 'fe80::cc25:eaff:fe93:a4a4', 'fe80::fc16:3eff:fef6:497f', 'fe80::1824:d5ff:fe14:fedb', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fee3:ca63', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897'] 
May 14 04:31:11.116003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:11.116003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:11.116003 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:11.116003 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating existing volume attachment record: 6bffe5e5-063a-4302-83a2-0c28f76b6dd2 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:11.420691 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005178699998396041 future=<Future at 0x7435f823ba40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:11.424312 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Emitting event <LifecycleEvent: 1778733056.4200094, c83f1eb6-8fdf-4986-8264-33870c021e33 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:11.424312 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] VM Stopped (Lifecycle Event)
May 14 04:31:11.425848 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:11.427239 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.955979802999991 future=<Future at 0x7435f82505c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:11.427239 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.955805525999949 future=<Future at 0x7435f82505c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:11.932206 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: c83f1eb6-8fdf-4986-8264-33870c021e33] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:12.394258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:12.394750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:12.394890 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Attaching volume 37cc4971-1f1f-425d-a631-6e8439bc629a to /dev/vdb
May 14 04:31:12.445975 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:12.460031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:12.484560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:12.527019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:12.527517 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:12.539100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:12.541444 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fe79:5006', 'fe80::c83e:eaff:fe1a:2a01', 'fe80::fc16:3eff:febd:6c6', 'fe80::fc16:3eff:fe8a:34ca', 'fe80::fc16:3eff:fe1d:1c50', 'fe80::fc16:3eff:fedb:7d33', 'fe80::fc16:3eff:fe47:4942', 'fe80::cc25:eaff:fe93:a4a4', 'fe80::fc16:3eff:fef6:497f', 'fe80::1824:d5ff:fe14:fedb', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fee3:ca63', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897'] 
May 14 04:31:12.541601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:12.541770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:12.542113 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:12.542531 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating existing volume attachment record: ac64730c-90bf-4f39-8383-a3de153089e6 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:12.772860 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:12.773304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:13.112442 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:13.112836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:13.112999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:13.113450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:13.113728 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:13.128584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:13.129649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:13.130537 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:13.130701 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:13.131682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:13.131682 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:13.152967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:13.152967 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:13.154375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:13.154375 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:13.166215 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a] added
May 14 04:31:13.166215 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:13.166215 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:13.166215 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:13.166215 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:13.166215 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:13.166215 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:13.166559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:13.166732 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:13.166945 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:13.171153 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a] added
May 14 04:31:13.171153 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:13.171153 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:13.171153 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:13.171153 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:13.171153 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:13.171153 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:13.171637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:13.171637 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0409(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:13.171764 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:13.274193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:31:13.275629 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:31:13.278880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:31:13.278880 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Creating image(s)
May 14 04:31:13.278975 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:31:13.279140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Ensure instance console log exists: /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:31:13.279625 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:13.279907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:13.280160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:13.283232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start _get_guest_xml network_info=[{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6bffe5e5-063a-4302-83a2-0c28f76b6dd2', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0a5002bb-852b-4070-a4f7-a34f18aaca4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'serial': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:13.287235 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:13.288737 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004', uuid='0a5002bb-852b-4070-a4f7-a34f18aaca4f'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733073.288283) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:13.294635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:13.295171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:13.296405 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:13.296664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:13.297785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:13.298181 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:13.298335 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:13.298455 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:13.298609 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:13.298748 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:13.298856 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:13.299051 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:13.299204 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:13.299332 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:13.299523 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:13.304136 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:13.323445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:13.325929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:13.325929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:13.854185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:13.854185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:13.857133 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:31:13.857320 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Claim successful on node np0000000747
May 14 04:31:14.132287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:14.132471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:14.167543 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:14.174881 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:14.186255 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:14.186255 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:14.201175 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:14.201175 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.212546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.227647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.239719 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.240324 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.258247 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:14.303864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.50.100,3260]
May 14 04:31:14.303864 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.50.100,3260] successful.
May 14 04:31:14.303864 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.318571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.40.100,3260]
May 14 04:31:14.318571 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.40.100,3260] successful.
May 14 04:31:14.318571 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.319285 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.337408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.350724 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.351278 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:14.351278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:14.352406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] HCTL ('9', '-', '-', 0) found on session 63 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:14.352491 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.367229 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:14.367597 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:14.367597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:14.367972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:14.368737 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] HCTL ('10', '-', '-', 0) found on session 64 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:14.368834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching for a device in session 63 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0008863129999099328 future=<Future at 0x7435f82505c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Emitting event <LifecycleEvent: 1778733059.3821497, 09eb687f-f8dd-4062-b883-f2211b86533e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:14.388648 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] VM Stopped (Lifecycle Event)
May 14 04:31:14.397809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Searching for a device in session 64 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:14.397809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:14.540766 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:14.541384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:14.541495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:14.541827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:14.542744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:14.546083 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Terminating instance
May 14 04:31:14.611998 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:14.612665 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:31:14.639401 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:14.887197 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 09eb687f-f8dd-4062-b883-f2211b86533e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:15.052372 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:31:15.090230 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.112090 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.132343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:31:15.156531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.181279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.188502 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.299694 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:15.299694 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:15.299823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:15.300000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:15.300116 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:15.300720 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8198e27c-3d02-4262-a25f-abca256b1423 req-0235bc52-74d3-4821-b15d-5ffca31b9ca1 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:15.313705 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.318187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.410355 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.509242 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.563879 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.585536 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:15.590379 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.596925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:15.596925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:15.596925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:15.597801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:15.597949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8cc4558d-4656-4d3a-86be-e0f07aebca6e req-40b0c305-52f7-459b-b9d8-4f05f468c83d service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:15.617591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.646578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:15.661029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.728496 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.778181 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999626628999977 future=<Future at 0x7436182860f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:15.779447 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998277125999948 future=<Future at 0x7436182860f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:15.779848 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99798725100004 future=<Future at 0x7436182860f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:15.783953 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Instance destroyed successfully.
May 14 04:31:15.784454 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lazy-loading 'resources' on Instance uuid 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:15.848125 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.911967 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:15.911967 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:15.948337 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:15.957483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.047540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:16.047936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:16.048234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:16.048482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:16.048539 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:16.049883 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92f4054c-be98-42cb-87cf-e773c5fddc7b req-30616660-af34-4a74-82eb-1637246f4168 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:16.156467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found WWN 330000000751e00dd for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:16.156467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:16.156467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000751e00dd', 'path': '/dev/dm-6', 'multipath_id': '330000000751e00dd'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:16.156467 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000751e00dd', 'path': '/dev/dm-6', 'multipath_id': '330000000751e00dd'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:16.156695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.832s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:16.157052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:16.161445 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:16.175671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:16.177095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:16.177095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:16.177095 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:16.181732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:16.181732 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:16.196041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:16.196041 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:16.205220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:16.205220 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:16.214299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c] added
May 14 04:31:16.214299 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:16.214299 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:16.214299 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:16.214299 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:16.214299 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:16.214299 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:16.214643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:16.214698 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:16.214944 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:16.220959 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c] added
May 14 04:31:16.220959 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:16.220959 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:16.220959 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:16.220959 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:16.220959 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:16.220959 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:16.221414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:16.221414 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.043(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:16.221414 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:16.292770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.293638 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "679826a3-26c9-405f-a2f3-34d4340134b5", "address": "fa:16:3e:79:50:06", "network": {"id": "2b774f16-0d6c-46ca-8132-95a0100e5b5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-419317326-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap679826a3-26", "ovs_interfaceid": "679826a3-26c9-405f-a2f3-34d4340134b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.294089 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.294450 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.298417 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.302010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap679826a3-26, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.306666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.306666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.342540 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.344188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.344406 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b2affab-a2c3-48c4-9aa6-ef3c049bbea8) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.346404 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.346404 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.384453 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.387597 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:50:06,bridge_name='br-int',has_traffic_filtering=True,id=679826a3-26c9-405f-a2f3-34d4340134b5,network=Network(2b774f16-0d6c-46ca-8132-95a0100e5b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap679826a3-26')
May 14 04:31:16.389031 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.390139 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.392704 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.392704 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.394024 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.394820 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93d1a992-d3, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.396164 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.397469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.416668 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:16.425236 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.426690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.426842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=745bebf6-5124-4f5f-ba72-03cc369a10db) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.427535 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.428167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.458918 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.467654 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:06:c6,bridge_name='br-int',has_traffic_filtering=True,id=93d1a992-d312-47c0-bd27-02005cfdb5f5,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93d1a992-d3')
May 14 04:31:16.467654 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.467654 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.467654 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.467654 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.469776 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.470175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96b18678-fc, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.471820 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.472945 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.497239 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.498843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.498843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cca82611-5802-4d2a-b302-a849162a7675) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.499998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.499998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.522661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.526083 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:ca,bridge_name='br-int',has_traffic_filtering=True,id=96b18678-fcba-44b3-ba6b-adbe5544a062,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96b18678-fc')
May 14 04:31:16.526554 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.526775 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.527499 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.527499 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.528459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.528755 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap071b8798-7c, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.531172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.534720 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.548179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.550420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.550895 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e25ca98a-3503-4f8b-a31b-5f8ea003f666) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.555561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.567920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.569877 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:1c:50,bridge_name='br-int',has_traffic_filtering=True,id=071b8798-7c20-4bc2-9085-1189c5639d06,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071b8798-7c')
May 14 04:31:16.570949 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.571186 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.572021 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.572021 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.573497 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.573772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce04dea8-56, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.575185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.576101 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.586561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.587188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.587352 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f21fc2-0510-42f2-b317-6868c2fc963f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.588028 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.588458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.599667 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.602785 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:7d:33,bridge_name='br-int',has_traffic_filtering=True,id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554,network=Network(d00a66dd-3d71-4320-b799-31bb83764821),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce04dea8-56')
May 14 04:31:16.603404 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.603570 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.604054 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.604279 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.605964 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.606470 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28dc8cbf-1b, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.609241 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.610205 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.610886 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:16.612054 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:31:16.615450 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.616725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.616899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=712b8a4c-ec06-4733-9521-b2965d89dc6a) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.617661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.618065 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.626439 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.628732 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:42,bridge_name='br-int',has_traffic_filtering=True,id=28dc8cbf-1b8d-4085-9933-374f3afb1375,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28dc8cbf-1b')
May 14 04:31:16.629439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-569458513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-device-tagging-server-569458513',id=29,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ92ILOMgnR768IlhJnA1GtOHwuYdZMU0tRWbqSCHna52lY5ZT3etpnZKDfWX65M/dN5dsbqoczGitUwnh+MWE8a9l469K0l43Y7bHD0eQ8cbIUY7x/jBc4Wx00fjOnR9w==',key_name='tempest-keypair-1077163839',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434cba1835e7445d88c5e06f8000f80b',ramdisk_id='',reservation_id='r-ocv648n1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2056355007',owner_user_name='tempest-TaggedBootDevicesTest_v242-2056355007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='640e693a251443fdb4b297994247b01b',uuid=26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:16.629671 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converting VIF {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:16.630221 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:16.630417 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:16.631448 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.631716 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2dcc064-57, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.632993 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.634464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.634464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.636413 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.636413 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=669e5095-ee85-4703-ae3e-7bb77764e93d) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:16.638233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.639250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:16.639426 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:16.643162 np0000000747 nova-compute[97971]: INFO os_vif [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=d2dcc064-5740-4e0a-a1b5-21d988064509,network=Network(dc37d78c-fed9-4ff0-b357-c4dcfed70eca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2dcc064-57')
May 14 04:31:16.644663 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:16.645023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:16.645249 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:16.664612 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Attempting to attach volume 37cc4971-1f1f-425d-a631-6e8439bc629a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:31:16.665903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:   <alias name="ua-37cc4971-1f1f-425d-a631-6e8439bc629a"/>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:   <serial>37cc4971-1f1f-425d-a631-6e8439bc629a</serial>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:16.665903 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:31:16.927563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.073s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:16.928152 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:31:16.965649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:16.965649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:16.965649 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Attaching volume c1b3e152-aa66-4b3b-be4d-e735070fbe5c to /dev/vdb
May 14 04:31:17.026206 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:17.038869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:17.070571 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:17.122727 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:17.123307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:17.135315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:17.137548 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fee3:ca63', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897'] 
May 14 04:31:17.138934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:17.139207 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:17.139547 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:17.139899 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating existing volume attachment record: 13ec80cf-089b-49a9-ada9-c55fd3423233 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:17.215582 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:17.223163 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:17.241004 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:17.241004 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:17.246162 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:17.246162 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.268431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.275146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.297278 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.297750 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.304393 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:17.367283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.50.100,3260]
May 14 04:31:17.367283 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.50.100,3260] successful.
May 14 04:31:17.367283 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.377118 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.40.100,3260]
May 14 04:31:17.377118 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.40.100,3260] successful.
May 14 04:31:17.377118 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.386390 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.395128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:17.411099 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:17.412318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:17.412749 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:17.413218 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:17.413218 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:17.413338 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-679826a3-26c9-405f-a2f3-34d4340134b5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:17.413489 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:17.413682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:17.413847 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:17.413988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:17.414155 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:17.414366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:17.414426 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:17.414532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:17.414700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:17.414842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:17.414979 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:17.415380 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-93d1a992-d312-47c0-bd27-02005cfdb5f5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:17.415838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:17.416004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:17.416166 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:17.416295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:17.416422 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:17.416553 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff609583-7c94-4db2-a956-94fe02e792c8 req-70611557-e4fd-47a0-887e-7467ade4dade service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.418758 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.419050 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:17.419472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:17.419472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:17.420681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('13', '-', '-', 0) found on session 65 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:17.420791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:17.428012 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:17.428012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:17.428998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('14', '-', '-', 0) found on session 66 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:17.428998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:17.440490 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:31:17.440647 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:31:17.441028 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:17.441941 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:17.450506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 65 and hctl ['13', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:17.464426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 66 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:17.464426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:17.603320 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:17.604202 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:31:17.688190 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:17.688190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:17.688190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:17.688190 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:17.688190 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:17.688516 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7d8fa55d-bac3-4282-8a48-c19d506589b4 req-13444d73-b428-4fc5-a21b-5741bd5537e0 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-071b8798-7c20-4bc2-9085-1189c5639d06 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:17.723408 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:17.725550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:17.725760 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:17.745373 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c46830061c284ed38642cf66db196b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f0893fbf443a9853f0a36fc84ff4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:31:17.946372 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:31:18.225465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:18.228595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:18.228902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:18.229176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:18.229330 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:18.229906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ad3efe07-26b1-42f5-aa08-c6629f6ef422 req-9491d020-b735-4687-8a27-353520cf141b service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-d2dcc064-5740-4e0a-a1b5-21d988064509 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:18.360961 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Successfully created port: 3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:31:18.392227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:18.392227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:18.392227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:18.392227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No VIF found with MAC fa:16:3e:e3:ca:63, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:18.449427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 65 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:18.451576 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:31:18.453341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:18.611199 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:18.611199 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:18.611199 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:18.959573 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Booting with volume 7a1193c4-0b4d-4032-9ea7-91d5085b98d3 at /dev/vda
May 14 04:31:19.038554 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:19.061106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:19.098889 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:19.098889 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:19.126146 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:19.128687 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:19.128968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:19.129179 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:31:19.162650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:19.163201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:19.177236 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:19.179631 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fee3:ca63', 'fe80::f0dd:a8ff:fe99:82b7', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897'] 
May 14 04:31:19.179874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:19.180117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:19.180326 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:19.180742 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updating existing volume attachment record: fbd04fa1-4041-4fa3-b71e-731f8798ae14 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:19.215595 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Found WWN 3300000008a0edf56 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:19.216081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.060s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:19.216342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== connect_volume: return (5892ms) {'type': 'block', 'scsi_wwn': '3300000008a0edf56', 'path': '/dev/dm-7', 'multipath_id': '3300000008a0edf56'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:19.217273 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a0edf56', 'path': '/dev/dm-7', 'multipath_id': '3300000008a0edf56'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:19.219399 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.573s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:19.219520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'acfa5344-cf79-45e9-a4d8-a0099b8b321a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:19.219711 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:19.250774 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Successfully updated port: 3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:19.275246 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '55')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:19.275246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a', '56')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:19.278119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f827b9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:19.278868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:19.283735 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Flush multipath device 3300000006d1a4580 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:19.338891 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:19.393264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:19.450330 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:19.451493 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:19.458966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:19.477214 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:19.477502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:19.499352 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.553345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.40.100,3260]
May 14 04:31:19.553345 np0000000747 nova-compute[97971]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.40.100,3260] successful.
May 14 04:31:19.553345 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.558320 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:19.558662 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:19.558770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:19.558974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:19.559091 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:19.559249 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-96b18678-fcba-44b3-ba6b-adbe5544a062 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:19.559382 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:19.559852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:19.560439 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:19.560913 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:19.560913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:19.561090 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:19.561264 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:19.561561 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:19.561757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:19.561924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:19.562257 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:19.562408 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:19.563357 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:19.564084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:19.564307 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:19.564671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:19.564671 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:19.565960 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-618246af-d0da-4cc6-80e1-8721ee6bd18f req-8688607c-0c88-43a3-8ae8-e2a4a4996606 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:19.584079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.604410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.647730 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.50.100,3260]
May 14 04:31:19.647730 np0000000747 nova-compute[97971]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-acfa5344-cf79-45e9-a4d8-a0099b8b321a, portal: 192.168.50.100,3260] successful.
May 14 04:31:19.647730 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.676282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.677209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:19.677209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== disconnect_volume: return (3031ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:19.677721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:19.678644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.953s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:19.678932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:19.685623 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:19.686363 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:19.686638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:19.696444 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:19.697356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:19.698381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:19.698381 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:19.698902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:19.699324 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:19.719410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:19.719410 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.725037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:19.725037 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.731159 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1055296004',id=36,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-k33dfdt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:07Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=0a5002bb-852b-4070-a4f7-a34f18aaca4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:19.731469 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:19.732541 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:19.737139 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c] added
May 14 04:31:19.741689 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:19.741689 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0429(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:19.741689 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:19.745602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c] added
May 14 04:31:19.745602 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:19.745602 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:19.745602 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:19.745602 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:19.745602 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:19.745602 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:19.745951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:19.745951 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0469(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:19.746252 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:19.756419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:19.757553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquired lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:19.757553 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:19.814424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-changed-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:19.815094 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Refreshing instance network info cache due to event network-changed-3241c6b3-ef44-48e7-bc6c-cf57773edcc8. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:19.815536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] Acquiring lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:19.986327 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ed19a3ae-5f79-4495-aac2-1bd611d6f6e9 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.592s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:20.218236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.248139 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <uuid>0a5002bb-852b-4070-a4f7-a34f18aaca4f</uuid>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <name>instance-00000024</name>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1055296004</nova:name>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:13</nova:creationTime>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         <nova:port uuid="aab5398f-df66-42f8-a56f-30a6adccb675">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="serial">0a5002bb-852b-4070-a4f7-a34f18aaca4f</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="uuid">0a5002bb-852b-4070-a4f7-a34f18aaca4f</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <alias name="ua-d313a9a1-97b5-4351-8cd0-eaddb2bba57c"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-7"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <serial>d313a9a1-97b5-4351-8cd0-eaddb2bba57c</serial>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:22:18:9e"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <target dev="tapaab5398f-df"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/console.log" append="off"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:20.248139 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:20.251176 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Preparing to wait for external event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:20.251176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:20.251176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:20.251176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:20.252882 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1055296004',id=36,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-k33dfdt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:07Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=0a5002bb-852b-4070-a4f7-a34f18aaca4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:20.253138 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:20.255322 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:20.255322 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:20.257700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.261030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:20.261963 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:20.268944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.270718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e8ac998-22e2-52a8-bc35-21aa85e5ff40', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:20.272760 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:20.274247 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.279011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.279011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaab5398f-df, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:20.279011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaab5398f-df, col_values=(('qos', UUID('7eb16e6c-53b3-48c9-a524-86939f5944d2')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:20.279011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaab5398f-df, col_values=(('external_ids', {'iface-id': 'aab5398f-df66-42f8-a56f-30a6adccb675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:18:9e', 'vm-uuid': '0a5002bb-852b-4070-a4f7-a34f18aaca4f'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:20.281332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.281332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:20.291773 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.299253 np0000000747 nova-compute[97971]: INFO os_vif [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df')
May 14 04:31:20.325523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:20.328633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.376255 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:20.446356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:20.457720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:20.460279 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:20.460279 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:20.462444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.618263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:20.618263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.716481 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:20.744587 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:20.747352 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:20.749051 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:20.755243 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-11 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:20.758721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:20.783307 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:20.783307 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:20.788662 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:20.788662 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.803042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.809839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.832126 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.839764 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.842683 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:20.880094 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:20.880780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:20.901130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.40.100,3260]
May 14 04:31:20.901130 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.40.100,3260] successful.
May 14 04:31:20.901130 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.926744 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updating instance_info_cache with network_info: [{"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:20.931492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.932345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.50.100,3260]
May 14 04:31:20.932345 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.50.100,3260] successful.
May 14 04:31:20.932345 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.955725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:20.956584 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.959442 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.959967 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:20.960506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.263s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:20.960639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:20.962169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('7', '-', '-', 0) found on session 67 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:20.962275 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:20.980901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 67 and hctl ['7', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.988650 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:20.989516 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:20.989516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:20.990966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('8', '-', '-', 0) found on session 68 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:20.991127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:21.001262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.008526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.029871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 68 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:21.030017 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:21.139132 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.139863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.249849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.260046 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:21.262964 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.377136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.380688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.402321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:31:21.406188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Creating image(s)
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Ensure instance console log exists: /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:21.408770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:21.433982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Releasing lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:21.433982 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Instance network_info: |[{"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:21.435115 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] Acquired lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:21.435302 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Refreshing network info cache for port 3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:21.439087 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Start _get_guest_xml network_info=[{"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fbd04fa1-4041-4fa3-b71e-731f8798ae14', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e930721b-9b58-4015-82d0-f492555ce544', 'attached_at': '', 'detached_at': '', 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'serial': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:21.444872 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:21.444872 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1415036733', uuid='e930721b-9b58-4015-82d0-f492555ce544'), owner=OwnerMeta(userid='c46830061c284ed38642cf66db196b0d', username='tempest-AttachVolumeMultiAttachTest-1725820811-project-member', projectid='b93f0893fbf443a9853f0a36fc84ff4c', projectname='tempest-AttachVolumeMultiAttachTest-1725820811'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733081.4439578) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:21.446836 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:21.446836 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:21.448416 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:21.449011 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:21.452663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:21.453423 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:21.470951 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:21.471894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:21.472253 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:21.488598 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.488997 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:31:21.491955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.611452 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.613105 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.673291 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:21.674422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] Acquiring lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:21.676315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:21.677793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:21.678158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] No waiting events found dispatching network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:21.678354 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9a452ffd-b035-4ed7-a79a-fb257421d0c2 req-ab44ff31-729c-4ed9-aa60-645fffe6862e service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-unplugged-28dc8cbf-1b8d-4085-9933-374f3afb1375 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:21.714833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.730392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.843187 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:21.844280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:21.844280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:22:18:9e, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:21.844454 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Using config drive
May 14 04:31:21.855249 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.855786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.942657 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:21.967865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:21.978638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:21.996558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 67 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:21.997821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:22.093704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:22.096789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:22.200063 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:22.209516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:22.318364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:22.318801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:22.605645 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:22.608825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:22.621641 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:22.624302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:22.667572 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:22.683421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:22.684022 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=10856MB free_disk=73.0683479309082GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:31:22.685953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:22.685953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:22.722727 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found WWN 3300000008d3c822d for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:22.723235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:22.723470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== connect_volume: return (4997ms) {'type': 'block', 'scsi_wwn': '3300000008d3c822d', 'path': '/dev/dm-0', 'multipath_id': '3300000008d3c822d'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:22.723930 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008d3c822d', 'path': '/dev/dm-0', 'multipath_id': '3300000008d3c822d'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:22.724469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:22.724978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:22.725433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:22.727972 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0 (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:22.773468 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:22.774671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:22.774844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '60')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:22.781167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0', '59')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:22.783985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618392a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:22.784339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:22.784634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Flush multipath device 33000000065b076c9 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:22.818318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:22.876636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:22.928261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:22.928489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:22.929964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:22.946195 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Creating config drive at /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config
May 14 04:31:22.946936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:22.947433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:22.952993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpainnje85 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:22.978851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:22.999166 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updated VIF entry in instance network info cache for port 3241c6b3-ef44-48e7-bc6c-cf57773edcc8. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:31:22.999166 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updating instance_info_cache with network_info: [{"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:23.033625 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.40.100,3260]
May 14 04:31:23.033625 np0000000747 nova-compute[97971]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.40.100,3260] successful.
May 14 04:31:23.033625 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.041915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpainnje85" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:23.075961 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.095047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.144843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.50.100,3260]
May 14 04:31:23.144843 np0000000747 nova-compute[97971]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-be24eba5-bbd0-423c-a3d1-e85718a1b9d0, portal: 192.168.50.100,3260] successful.
May 14 04:31:23.144843 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.177572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.177572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:23.179869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== disconnect_volume: return (3490ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:23.179869 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:23.179869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.707s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:23.179869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:23.186924 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:23.187454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:23.187825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:23.203850 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:23.203970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:23.205163 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:23.205163 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:23.206571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:23.207583 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:23.233789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Attempting to attach volume c1b3e152-aa66-4b3b-be4d-e735070fbe5c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:31:23.238505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:23.238505 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.240186 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:23.240186 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.242584 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:   <alias name="ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c"/>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:   <serial>c1b3e152-aa66-4b3b-be4d-e735070fbe5c</serial>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:23.242584 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:31:23.253933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.259871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3] added
May 14 04:31:23.259871 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:23.259871 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:23.259871 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:23.259871 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:23.259871 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:23.259871 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.260189 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:23.260284 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0536(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:23.260473 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:23.266456 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3] added
May 14 04:31:23.266456 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:23.266456 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:23.266456 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:23.266456 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:23.266456 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:23.266456 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:23.266922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:23.266970 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.062(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:23.267188 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:23.503127 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4e9bb8bf-0578-45ea-9dc0-00d596768e5f req-1dddf403-e9b7-48f3-92fe-35a4b0580792 service nova] Releasing lock "refresh_cache-e930721b-9b58-4015-82d0-f492555ce544" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:23.721295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.754153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.761198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.812165 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.812313 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5d42ebce-6d76-4893-b335-bceb7181a83a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3370940d-3bd7-45f3-887f-9c515137a348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 4d665afc-c146-44a9-af0b-e36fcd96568a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813098 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 85a9913c-942d-4796-86b3-dc12a56ee6fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813341 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance be285f62-66b7-4e5c-84a6-077afe0a69fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813341 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 8535c256-4cff-4edb-9e78-23028fb7a32d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813424 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 8860392d-b13e-43fe-9f11-b8800d1ba6fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813534 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813675 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 0a5002bb-852b-4070-a4f7-a34f18aaca4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.813934 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance e930721b-9b58-4015-82d0-f492555ce544 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:31:23.814282 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:31:23.814504 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=3328MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:31:22 up 31 min,  2 users,  load average: 9.84, 7.86, 4.09\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '11', 'num_os_type_None': '14', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '6', 'io_workload': '2', 'num_proj_3030a0d75e9c41828981f529272fd47f': '4', 'num_task_deleting': '1', 'num_proj_434cba1835e7445d88c5e06f8000f80b': '1', 'num_proj_59f783f79d26485a8347214b526fd33a': '1', 'num_proj_9e1481ce79a54b72a2f83aa185ea46d1': '1', 'num_proj_cf8b3bba7862432eb957054a0284982b': '1', 'num_vm_building': '2', 'num_task_spawning': '2'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:31:23.866544 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.867396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:23.886894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:24.260977 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:24.268999 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:24.284647 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:24.284647 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:24.296179 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:24.296179 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.302887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.312300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.325781 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.326075 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.335327 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.335739 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:24.400330 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.50.100,3260]
May 14 04:31:24.400330 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.50.100,3260] successful.
May 14 04:31:24.400330 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.411876 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.40.100,3260]
May 14 04:31:24.411876 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.40.100,3260] successful.
May 14 04:31:24.411876 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.419191 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.426665 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.447456 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.448037 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:24.448037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:24.450047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('15', '-', '-', 0) found on session 69 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:24.450159 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.455468 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:24.455905 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:24.456309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.252s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:24.456309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:24.457917 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] HCTL ('16', '-', '-', 0) found on session 70 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:24.458073 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:24.474861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 69 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:24.475039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:24.487543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Searching for a device in session 70 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:24.487973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:24.749698 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:24.749698 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:24.918487 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733084.9179592, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:24.918997 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Started (Lifecycle Event)
May 14 04:31:25.150983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:25.153606 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:25.153751 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:25.153885 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:06:14:f3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:25.205239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:31:25.252823 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:25.280559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:25.422030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:25.424013 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733085.423746, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:25.424194 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Paused (Lifecycle Event)
May 14 04:31:25.764801 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:31:25.764801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.078s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:25.764801 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:31:25.927662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:25.930736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:25.959422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:26.227981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Found WWN 330000000ce9fc06f for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:26.228168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:26.228343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== connect_volume: return (4755ms) {'type': 'block', 'scsi_wwn': '330000000ce9fc06f', 'path': '/dev/dm-1', 'multipath_id': '330000000ce9fc06f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:26.228469 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ce9fc06f', 'path': '/dev/dm-1', 'multipath_id': '330000000ce9fc06f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:26.229904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.042s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:26.230320 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:26.230505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:26.262482 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d1f7c898-3e59-4dc5-b538-a2d5455ab45b req-48632236-f109-4e5e-930c-fd61fbfdf0dd service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:26.262681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1f7c898-3e59-4dc5-b538-a2d5455ab45b req-48632236-f109-4e5e-930c-fd61fbfdf0dd service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:26.262824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1f7c898-3e59-4dc5-b538-a2d5455ab45b req-48632236-f109-4e5e-930c-fd61fbfdf0dd service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:26.263225 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d1f7c898-3e59-4dc5-b538-a2d5455ab45b req-48632236-f109-4e5e-930c-fd61fbfdf0dd service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:26.263402 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d1f7c898-3e59-4dc5-b538-a2d5455ab45b req-48632236-f109-4e5e-930c-fd61fbfdf0dd service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Processing event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:26.264653 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:26.267502 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:26.269632 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance spawned successfully.
May 14 04:31:26.270003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:26.273432 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:26.273861 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:26.274167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '70')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:26.274167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '61')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:26.275719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c', '62')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:26.278303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f85e5bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'): ({'sdo'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:26.278684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Removing multipathed devices sdn, sdo {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:26.279469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Flush multipath device 33000000057131735 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:26.315066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:26.372418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:26.430139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:26.430512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:26.432715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:26.433665 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:26.436120 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733086.433885, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:26.436120 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Resumed (Lifecycle Event)
May 14 04:31:26.446373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:26.446599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:26.459609 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.505438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.40.100,3260]
May 14 04:31:26.505438 np0000000747 nova-compute[97971]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.40.100,3260] successful.
May 14 04:31:26.505438 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.529952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.549421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.594114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.50.100,3260]
May 14 04:31:26.594114 np0000000747 nova-compute[97971]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-5e6cf1e8-a1bf-4634-9d5e-b6427a99928c, portal: 192.168.50.100,3260] successful.
May 14 04:31:26.594114 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.622025 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:26.622338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:26.622577 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] <== disconnect_volume: return (3434ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:26.622708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:26.622994 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Deleting instance files /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949_del
May 14 04:31:26.623807 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Deletion of /opt/stack/data/nova/instances/26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949_del complete
May 14 04:31:26.713379 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:26.728721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce55f62c-c30c-44e6-9152-568fa95cc11f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.763s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:26.747260 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1415036733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-1415036733',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-ogcxqcl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:18Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=e930721b-9b58-4015-82d0-f492555ce544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:26.747569 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:26.748249 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:26.749418 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'pci_devices' on Instance uuid e930721b-9b58-4015-82d0-f492555ce544 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:26.764170 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:26.764868 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:31:26.765068 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:31:26.766199 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.84 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:31:26.779045 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.779045 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.779209 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.779440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.780809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.780809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:26.937670 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:26.939441 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:27.050253 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:27.050506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:27.131218 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Took 12.08 seconds to destroy the instance on the hypervisor.
May 14 04:31:27.132107 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:27.132315 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:27.132419 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:27.132698 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:27.193607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:27.231457 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:27.255979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <uuid>e930721b-9b58-4015-82d0-f492555ce544</uuid>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <name>instance-00000025</name>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1415036733</nova:name>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:21</nova:creationTime>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:user uuid="c46830061c284ed38642cf66db196b0d">tempest-AttachVolumeMultiAttachTest-1725820811-project-member</nova:user>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:project uuid="b93f0893fbf443a9853f0a36fc84ff4c">tempest-AttachVolumeMultiAttachTest-1725820811</nova:project>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         <nova:port uuid="3241c6b3-ef44-48e7-bc6c-cf57773edcc8">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="serial">e930721b-9b58-4015-82d0-f492555ce544</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="uuid">e930721b-9b58-4015-82d0-f492555ce544</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/disk.config"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <alias name="ua-7a1193c4-0b4d-4032-9ea7-91d5085b98d3"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <serial>7a1193c4-0b4d-4032-9ea7-91d5085b98d3</serial>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <shareable/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:da:3b:10"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <target dev="tap3241c6b3-ef"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/console.log" append="off"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:27.255979 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Preparing to wait for external event network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1415036733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-1415036733',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-ogcxqcl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:18Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=e930721b-9b58-4015-82d0-f492555ce544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:27.258498 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:27.259209 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:27.260972 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:27.260972 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:27.260972 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:27.260972 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:27.264917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:27.265066 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69539f51-cf37-5fe1-a81b-6ad15847002d', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:27.270171 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:27.275770 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:27.275995 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3241c6b3-ef, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:27.276403 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3241c6b3-ef, col_values=(('qos', UUID('f1573c29-c0a7-4eb6-a359-a7df727f9f63')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:27.276590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3241c6b3-ef, col_values=(('external_ids', {'iface-id': '3241c6b3-ef44-48e7-bc6c-cf57773edcc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:3b:10', 'vm-uuid': 'e930721b-9b58-4015-82d0-f492555ce544'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:27.279331 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:27.287816 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Took 14.01 seconds to spawn the instance on the hypervisor.
May 14 04:31:27.287960 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:27.289010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:27.290218 np0000000747 nova-compute[97971]: INFO os_vif [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef')
May 14 04:31:27.442645 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:27.553924 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Detaching volume 37cc4971-1f1f-425d-a631-6e8439bc629a
May 14 04:31:27.622793 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Attempting to driver detach volume 37cc4971-1f1f-425d-a631-6e8439bc629a from mountpoint /dev/vdb
May 14 04:31:27.630755 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found disk vdb by alias ua-37cc4971-1f1f-425d-a631-6e8439bc629a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:31:27.632281 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Found disk vdb by alias ua-37cc4971-1f1f-425d-a631-6e8439bc629a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:31:27.632848 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Attempting to detach device vdb from instance be285f62-66b7-4e5c-84a6-077afe0a69fb from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:31:27.633179 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <alias name="ua-37cc4971-1f1f-425d-a631-6e8439bc629a"/>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <serial>37cc4971-1f1f-425d-a631-6e8439bc629a</serial>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:27.633179 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:31:27.642024 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully detached device vdb from instance be285f62-66b7-4e5c-84a6-077afe0a69fb from the persistent domain config.
May 14 04:31:27.642286 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] (1/8): Attempting to detach device vdb with device alias ua-37cc4971-1f1f-425d-a631-6e8439bc629a from instance be285f62-66b7-4e5c-84a6-077afe0a69fb from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:31:27.643196 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <alias name="ua-37cc4971-1f1f-425d-a631-6e8439bc629a"/>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <serial>37cc4971-1f1f-425d-a631-6e8439bc629a</serial>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:27.643196 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:31:27.803450 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Took 25.77 seconds to build instance.
May 14 04:31:28.308576 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e707f531-8163-4ffe-a250-606f08649d3a tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.281s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:28.311395 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733088.3109586, be285f62-66b7-4e5c-84a6-077afe0a69fb => ua-37cc4971-1f1f-425d-a631-6e8439bc629a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:31:28.317412 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-37cc4971-1f1f-425d-a631-6e8439bc629a for instance be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:31:28.325928 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully detached device vdb from instance be285f62-66b7-4e5c-84a6-077afe0a69fb from the live domain config.
May 14 04:31:28.328086 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:28.328469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:28.328663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:28.329173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:28.329634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:28.329869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:28.348292 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-914be22e-0e0f-485c-9e49-8cd84b0b9275 req-ba753daa-7599-440b-af02-a6c28698467c service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state None.
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:28.378436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '70')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:28.378436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '64')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:28.381159 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', '63')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:28.386553 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618279760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:28.387190 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:28.387551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Flush multipath device 330000000751e00dd {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:28.422463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:28.467823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:28.523754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:28.523905 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:28.525327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:28.538814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:28.539021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:28.554809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.601095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.40.100,3260]
May 14 04:31:28.601095 np0000000747 nova-compute[97971]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.40.100,3260] successful.
May 14 04:31:28.601095 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.624721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.644005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.685439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.50.100,3260]
May 14 04:31:28.685439 np0000000747 nova-compute[97971]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, portal: 192.168.50.100,3260] successful.
May 14 04:31:28.685439 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.731723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:28.732054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:28.732240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== disconnect_volume: return (403ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:28.732515 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:28.816642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:28.817637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:28.817637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] No VIF found with MAC fa:16:3e:da:3b:10, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:28.817949 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Using config drive
May 14 04:31:29.322044 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'flavor' on Instance uuid be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:29.325927 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:29.506644 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Creating config drive at /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/disk.config
May 14 04:31:29.513803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe9ls3zqa {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:29.587494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe9ls3zqa" returned: 0 in 0.075s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:29.882064 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Rescuing
May 14 04:31:29.883366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:29.883366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:29.883366 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:30.109690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:30.109971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:30.132872 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cb8a5c37-ce16-4561-b0f3-927f7981eca7 req-501a7233-9f6e-43ac-b7eb-cf691da57245 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-deleted-679826a3-26c9-405f-a2f3-34d4340134b5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:30.133039 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-cb8a5c37-ce16-4561-b0f3-927f7981eca7 req-501a7233-9f6e-43ac-b7eb-cf691da57245 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Neutron deleted interface 679826a3-26c9-405f-a2f3-34d4340134b5; detaching it from the instance and deleting it from the info cache
May 14 04:31:30.133429 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-cb8a5c37-ce16-4561-b0f3-927f7981eca7 req-501a7233-9f6e-43ac-b7eb-cf691da57245 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "address": "fa:16:3e:db:7d:33", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce04dea8-56", "ovs_interfaceid": "ce04dea8-56f7-46d5-9f5c-3b3691f4c554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:30.136604 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.174450 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.176086 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.272161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.323785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.327877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.334500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6c0671b8-5607-4c6b-a6f3-1bcd6476f0d7 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:30.336026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.141s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:30.336026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:30.336443 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:30.336667 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:30.338852 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Terminating instance
May 14 04:31:30.388364 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:30.443982 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-deleted-ce04dea8-56f7-46d5-9f5c-3b3691f4c554 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:30.444181 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Neutron deleted interface ce04dea8-56f7-46d5-9f5c-3b3691f4c554; detaching it from the instance and deleting it from the info cache
May 14 04:31:30.444647 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "address": "fa:16:3e:47:49:42", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28dc8cbf-1b", "ovs_interfaceid": "28dc8cbf-1b8d-4085-9933-374f3afb1375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:30.612764 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:31:30.650662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cb8a5c37-ce16-4561-b0f3-927f7981eca7 req-501a7233-9f6e-43ac-b7eb-cf691da57245 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Detach interface failed, port_id=679826a3-26c9-405f-a2f3-34d4340134b5, reason: Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:30.760055 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:30.778560 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0007786829999076872 future=<Future at 0x7436182860f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:30.779174 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Emitting event <LifecycleEvent: 1778733075.7776358, 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:30.779395 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:30.779640 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] VM Stopped (Lifecycle Event)
May 14 04:31:30.843412 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:31:30.845993 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:30.870957 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.877780 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.896053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.904401 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.932161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.952325 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Detach interface failed, port_id=ce04dea8-56f7-46d5-9f5c-3b3691f4c554, reason: Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:30.952325 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-deleted-28dc8cbf-1b8d-4085-9933-374f3afb1375 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:30.952325 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Neutron deleted interface 28dc8cbf-1b8d-4085-9933-374f3afb1375; detaching it from the instance and deleting it from the info cache
May 14 04:31:30.952325 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "071b8798-7c20-4bc2-9085-1189c5639d06", "address": "fa:16:3e:1d:1c:50", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap071b8798-7c", "ovs_interfaceid": "071b8798-7c20-4bc2-9085-1189c5639d06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:30.960508 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:30.970870 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:31.137510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:31.137776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:31.191094 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:31.192964 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:31.199779 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:31:31.199936 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Claim successful on node np0000000747
May 14 04:31:31.208400 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999699525999858 future=<Future at 0x74363d73c5c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:31.209522 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998536704999879 future=<Future at 0x74363d73c5c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:31.209854 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99822426899982 future=<Future at 0x74363d73c5c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:31.213420 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Instance destroyed successfully.
May 14 04:31:31.213924 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lazy-loading 'resources' on Instance uuid be285f62-66b7-4e5c-84a6-077afe0a69fb {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:31.223998 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733091.223579, e930721b-9b58-4015-82d0-f492555ce544 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:31.224222 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] VM Started (Lifecycle Event)
May 14 04:31:31.282311 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b282252-e899-40cc-b493-8541c53e9592 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:31.350821 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Took 4.22 seconds to deallocate network for instance.
May 14 04:31:31.459607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Detach interface failed, port_id=28dc8cbf-1b8d-4085-9933-374f3afb1375, reason: Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:31.459607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-deleted-071b8798-7c20-4bc2-9085-1189c5639d06 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:31.459607 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Neutron deleted interface 071b8798-7c20-4bc2-9085-1189c5639d06; detaching it from the instance and deleting it from the info cache
May 14 04:31:31.459607 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2dcc064-5740-4e0a-a1b5-21d988064509", "address": "fa:16:3e:f6:49:7f", "network": {"id": "dc37d78c-fed9-4ff0-b357-c4dcfed70eca", "bridge": "br-int", "label": "tempest-device-tagging-net2-252514485", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2dcc064-57", "ovs_interfaceid": "d2dcc064-5740-4e0a-a1b5-21d988064509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:31.474529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:31.643263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:31:31.717272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102335604',display_name='tempest-VolumesSnapshotTestJSON-instance-102335604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumessnapshottestjson-instance-102335604',id=31,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW7EyGr2pR3V6eyDUjcfrzGTBupEzJOQBuxELdRAySd9brd4hRs4wBFLYSza0jYC4ksf3y9kc+UQxf//+8zd51OtL8s/oeSGdNcQ4wLEhAZU+cCWfWFAtZYiWmDI0owng==',key_name='tempest-keypair-955635961',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:30Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59f783f79d26485a8347214b526fd33a',ramdisk_id='',reservation_id='r-fzyi9y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-9761619',owner_user_name='tempest-VolumesSnapshotTestJSON-9761619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0d4a5b05c94a7697d02ed951f21543',uuid=be285f62-66b7-4e5c-84a6-077afe0a69fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:31.717583 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converting VIF {"id": "63094e41-ebd7-481f-a17f-8931686f90d7", "address": "fa:16:3e:e3:ca:63", "network": {"id": "abfd6394-eff5-4880-a4ad-c629723f95ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1847763874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59f783f79d26485a8347214b526fd33a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63094e41-eb", "ovs_interfaceid": "63094e41-ebd7-481f-a17f-8931686f90d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:31.718083 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:31.718299 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:31.719661 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:31.719916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63094e41-eb, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:31.721128 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:31.721889 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:31.722666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:31.725030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:31.725030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc8d35b2-fa86-4033-8751-b9cda8d1a492) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:31.725030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:31.725369 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:31.727536 np0000000747 nova-compute[97971]: INFO os_vif [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ca:63,bridge_name='br-int',has_traffic_filtering=True,id=63094e41-ebd7-481f-a17f-8931686f90d7,network=Network(abfd6394-eff5-4880-a4ad-c629723f95ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63094e41-eb')
May 14 04:31:31.728655 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37cc4971-1f1f-425d-a631-6e8439bc629a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:31.732869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:31.737023 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733091.736759, e930721b-9b58-4015-82d0-f492555ce544 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:31.737147 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] VM Paused (Lifecycle Event)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:31.779604 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:31.780113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '70')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:31.780113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:31.780113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:31:31.780113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:31.780249 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37cc4971-1f1f-425d-a631-6e8439bc629a') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:31:31.780315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361827b2e0>, {}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:31.780436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Disconnecting from: [] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:31.780629 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:31.780793 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] <== disconnect_volume: return (50ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:31.784705 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:31.784705 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Deleting instance files /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb_del
May 14 04:31:31.784705 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Deletion of /opt/stack/data/nova/instances/be285f62-66b7-4e5c-84a6-077afe0a69fb_del complete
May 14 04:31:31.962150 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Detach interface failed, port_id=071b8798-7c20-4bc2-9085-1189c5639d06, reason: Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:31.962150 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Received event network-vif-deleted-d2dcc064-5740-4e0a-a1b5-21d988064509 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:31.962150 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Neutron deleted interface d2dcc064-5740-4e0a-a1b5-21d988064509; detaching it from the instance and deleting it from the info cache
May 14 04:31:31.962439 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Updating instance_info_cache with network_info: [{"id": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "address": "fa:16:3e:bd:06:c6", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93d1a992-d3", "ovs_interfaceid": "93d1a992-d312-47c0-bd27-02005cfdb5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96b18678-fcba-44b3-ba6b-adbe5544a062", "address": "fa:16:3e:8a:34:ca", "network": {"id": "d00a66dd-3d71-4320-b799-31bb83764821", "bridge": "br-int", "label": "tempest-device-tagging-net1-680657925", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "434cba1835e7445d88c5e06f8000f80b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b18678-fc", "ovs_interfaceid": "96b18678-fcba-44b3-ba6b-adbe5544a062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:32.197143 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:32.215562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:32.215562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:32.216130 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:32.216403 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:32.216712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Processing event network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:32.216963 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:32.217202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:32.217445 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:32.217787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:32.218149 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] No waiting events found dispatching network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:32.218961 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:32.219147 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received unexpected event network-vif-plugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 for instance with vm_state building and task_state spawning.
May 14 04:31:32.219317 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:32.219752 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:32.220043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:32.220538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:32.220745 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] No waiting events found dispatching network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:32.222326 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:32.222326 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:32.222326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Acquiring lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:32.222326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:32.222326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:32.222673 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] No waiting events found dispatching network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:32.222795 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4bbbed5-c9c6-4699-8fa6-415ebc2a82af req-a0f91243-ddd3-4959-89e7-bb7961c1e920 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-unplugged-63094e41-ebd7-481f-a17f-8931686f90d7 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:32.223080 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:32.224947 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] Instance spawned successfully.
May 14 04:31:32.225497 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:32.239410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:32.241949 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733092.241745, e930721b-9b58-4015-82d0-f492555ce544 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:32.242116 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] VM Resumed (Lifecycle Event)
May 14 04:31:32.288160 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Took 1.44 seconds to destroy the instance on the hypervisor.
May 14 04:31:32.289014 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:32.289346 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:32.289477 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:32.289702 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:32.396787 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:32.466594 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7b11cb5-5f4b-491d-8714-c519493a55db req-08945bc9-e676-440f-86bd-338e09a65ef7 service nova] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Detach interface failed, port_id=d2dcc064-5740-4e0a-a1b5-21d988064509, reason: Instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:32.738049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.738049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.738049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.738049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.738789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.738789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:32.748428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:32.755500 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:33.062502 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] [instance: 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949] Took 1.71 seconds to detach 3 volumes for instance.
May 14 04:31:33.112025 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-11ec8e60-e04d-4865-8665-6a13dbed7208 req-25cb2979-8de7-4b44-a343-d1bfbd29ba15 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Received event network-vif-deleted-63094e41-ebd7-481f-a17f-8931686f90d7 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:33.112025 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-11ec8e60-e04d-4865-8665-6a13dbed7208 req-25cb2979-8de7-4b44-a343-d1bfbd29ba15 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Neutron deleted interface 63094e41-ebd7-481f-a17f-8931686f90d7; detaching it from the instance and deleting it from the info cache
May 14 04:31:33.112025 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-11ec8e60-e04d-4865-8665-6a13dbed7208 req-25cb2979-8de7-4b44-a343-d1bfbd29ba15 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:33.151140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.157828 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.177923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.246251 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Took 11.84 seconds to spawn the instance on the hypervisor.
May 14 04:31:33.246452 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:33.262856 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e930721b-9b58-4015-82d0-f492555ce544] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:33.301336 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:33.302671 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:33.329842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.340859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.468911 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:33.469172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:33.469536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:33.469735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:33.469908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:33.470083 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-98c4a390-7e2e-40f7-b910-ef226634c863 req-bb98b6d8-aab4-4da4-9633-5f56270adac5 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state rescuing.
May 14 04:31:33.479094 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999673246999919 future=<Future at 0x74361825ecf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:33.487796 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance destroyed successfully.
May 14 04:31:33.488153 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:33.536083 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:33.573889 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:33.574877 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:33.619160 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-11ec8e60-e04d-4865-8665-6a13dbed7208 req-25cb2979-8de7-4b44-a343-d1bfbd29ba15 service nova] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Detach interface failed, port_id=63094e41-ebd7-481f-a17f-8931686f90d7, reason: Instance be285f62-66b7-4e5c-84a6-077afe0a69fb could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:33.761520 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Took 19.98 seconds to build instance.
May 14 04:31:33.806646 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:33.992177 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Attempting a stable device rescue
May 14 04:31:34.039163 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Took 1.75 seconds to deallocate network for instance.
May 14 04:31:34.066871 np0000000747 nova-compute[97971]: WARNING nova.volume.cinder [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Attachment ac64730c-90bf-4f39-8383-a3de153089e6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ac64730c-90bf-4f39-8383-a3de153089e6. (HTTP 404) (Request-ID: req-8848609c-8bf3-41aa-afa3-c8655308aa18)
May 14 04:31:34.067157 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Took 0.03 seconds to detach 1 volumes for instance.
May 14 04:31:34.104840 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=97971) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 14 04:31:34.109321 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance directory exists: not creating {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 14 04:31:34.109521 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Creating image(s)
May 14 04:31:34.110131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:34.110283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:34.110837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:34.111018 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:34.263785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:34.265731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.493s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:34.316376 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.121s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:34.316376 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:31:34.316765 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.120s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:34.320760 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:31:34.321039 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Claim successful on node np0000000747
May 14 04:31:34.575370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:34.613202 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:34.613579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5050a4f14765cc43c172619a82a698a7067ced5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:34.614437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5050a4f14765cc43c172619a82a698a7067ced5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:34.823803 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:31:34.824298 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:31:34.826765 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:34.826765 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:34.929919 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d28aa2d5d8d4d42931857f8b63ad188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1481ce79a54b72a2f83aa185ea46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:31:35.329826 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:31:35.345326 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.348236 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.349012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:35.476773 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.part --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:35.477686 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] 420a3afd-1749-459d-b9f8-1be7cc316c85 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:31:35.478209 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:31:35.478641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.part /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:35.532431 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Successfully created port: a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:31:35.582264 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:35.583379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:35.583379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:35.587917 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:35.589555 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:35.590375 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9bac41c6-cca2-429f-bf1c-8755869d166f req-241a6633-3400-4360-928d-4d70cede0554 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state rescuing.
May 14 04:31:35.607690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.part /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.converted" returned: 0 in 0.129s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:35.616113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:35.715574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e.converted --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:35.716447 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5050a4f14765cc43c172619a82a698a7067ced5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:35.717346 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.720221 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.727030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5050a4f14765cc43c172619a82a698a7067ced5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:35.728864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5050a4f14765cc43c172619a82a698a7067ced5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:35.729862 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.732474 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:35.733194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:35.849438 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:31:35.862824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e --force-share --output=json" returned: 0 in 0.128s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:35.862824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e,backing_fmt=raw /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.rescue {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:35.949650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5050a4f14765cc43c172619a82a698a7067ced5e,backing_fmt=raw /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.rescue" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:35.949650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5050a4f14765cc43c172619a82a698a7067ced5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:35.949650 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'migration_context' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:35.964084 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:36.345310 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Successfully updated port: a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:31:36.452154 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:36.452522 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:31:36.453439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start _get_guest_xml network_info=[{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:22:18:9e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '420a3afd-1749-459d-b9f8-1be7cc316c85', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6bffe5e5-063a-4302-83a2-0c28f76b6dd2', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, 'status': 'reserved', 'instance': '0a5002bb-852b-4070-a4f7-a34f18aaca4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'serial': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:36.453700 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:36.492008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:36.492509 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:36.725540 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:36.848898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:36.849101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquired lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:36.849294 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:36.867722 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Creating image(s)
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:36.872636 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:36.874972 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:36.876681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:36.957583 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:36.963641 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:36.969763 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004', uuid='0a5002bb-852b-4070-a4f7-a34f18aaca4f'), owner=OwnerMeta(userid='3b73f8491edc4c59b345fbd4d3b6c6b0', username='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member', projectid='3030a0d75e9c41828981f529272fd47f', projectname='tempest-ServerBootFromVolumeStableRescueTest-589525365'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:22:18:9e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733096.9643543) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:36.969763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:36.969763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:36.970137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:36.970137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:36.971990 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:36.972089 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:36.972292 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:36.972454 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:36.972633 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:36.972778 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:36.972929 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:36.973156 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:36.973322 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:36.973458 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:36.973597 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:36.973779 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:36.973944 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:36.998018 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:37.008290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.131s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.008781 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:37.009241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:37.010089 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:37.013437 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:37.013785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:37.109170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.095s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.110515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:37.171174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk 1073741824" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.171826 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:37.172251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:37.289548 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.117s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.290226 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:31:37.290432 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:37.355468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:37.391990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.392334 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Cannot resize image /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:31:37.392756 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:31:37.392979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Ensure instance console log exists: /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:31:37.393284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:37.393536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:37.393708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:37.449018 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:37.477857 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:37.502320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:37.536409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.219s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:37.539072 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:31:37.543940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.964s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:37.600897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:37.601323 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:37.601574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:37.602294 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:37.602741 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:37.604762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:37.604762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:37.604762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:37.604762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:37.618313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:37.619512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:37.619852 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:37.622949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:37.623731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:37.623731 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:37.646116 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:37.646116 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:37.653935 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:37.653935 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:37.670576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:37.680789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:37.684453 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-changed-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:37.684854 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Refreshing instance network info cache due to event network-changed-a2ffb049-b2a5-4576-9cf1-bc6056029d05. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:37.684928 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] Acquiring lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.698712 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.699071 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:37.699754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:37.699885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:37.704080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('14', '0', '0', 0) found on session 66 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:37.704196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.704546 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:37.705121 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:37.705559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.082s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:37.705559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:37.706753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] HCTL ('13', '0', '0', 0) found on session 65 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:37.706898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:37.721907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 66 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:37.722184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:37.723913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Searching for a device in session 65 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:37.724057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:37.735166 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:37.917456 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updating instance_info_cache with network_info: [{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:38.049184 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:31:38.050921 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:31:38.050921 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:38.050921 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:38.167049 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5673930adce14c6ea2b647e1a339636b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6495e941aabb4280afd6c384a250e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:31:38.419818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Releasing lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:38.420290 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Instance network_info: |[{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:38.420885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] Acquired lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:38.421109 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Refreshing network info cache for port a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:38.424094 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Start _get_guest_xml network_info=[{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:38.427575 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:38.430314 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-96565693', uuid='52be42da-de7d-4255-a2d2-84bd69a79605'), owner=OwnerMeta(userid='6d28aa2d5d8d4d42931857f8b63ad188', username='tempest-AttachVolumeNegativeTest-2053621712-project-member', projectid='9e1481ce79a54b72a2f83aa185ea46d1', projectname='tempest-AttachVolumeNegativeTest-2053621712'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733098.4291995) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:38.436604 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:38.438631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:38.440130 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:38.440701 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:38.442173 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:38.442563 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:38.443045 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:38.443207 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:38.443355 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:38.443505 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:38.443661 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:38.443843 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:38.443962 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:38.444080 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:38.444194 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:38.444321 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:38.460425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96565693',display_name='tempest-AttachVolumeNegativeTest-server-96565693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-96565693',id=38,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBwCnS4TEOJ5qmgM837AID2NX/mSY4Rim8FvY3X+06hL7JIp0zKerUjC1hVF219b+i0OD49/A+i/0DFreRVrTwKKQMSgOd/3FiLlxRUGJ7WGLQSFnMt2Ralz6gKzTrjUg==',key_name='tempest-keypair-2004684581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-z7m6tom0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=52be42da-de7d-4255-a2d2-84bd69a79605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:38.460673 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:38.461880 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:38.464432 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'pci_devices' on Instance uuid 52be42da-de7d-4255-a2d2-84bd69a79605 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:38.554738 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:31:38.585869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:38.586180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:38.586180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:38.586681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:38.586681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:38.589695 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Terminating instance
May 14 04:31:38.624798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:31:38.671358 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:38.671692 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:38.725017 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Successfully created port: 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:31:38.925875 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:38.968392 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <uuid>52be42da-de7d-4255-a2d2-84bd69a79605</uuid>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <name>instance-00000026</name>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeNegativeTest-server-96565693</nova:name>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:38</nova:creationTime>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:user uuid="6d28aa2d5d8d4d42931857f8b63ad188">tempest-AttachVolumeNegativeTest-2053621712-project-member</nova:user>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:project uuid="9e1481ce79a54b72a2f83aa185ea46d1">tempest-AttachVolumeNegativeTest-2053621712</nova:project>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         <nova:port uuid="a2ffb049-b2a5-4576-9cf1-bc6056029d05">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="serial">52be42da-de7d-4255-a2d2-84bd69a79605</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="uuid">52be42da-de7d-4255-a2d2-84bd69a79605</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.config"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:61:19:25"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <target dev="tapa2ffb049-b2"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/console.log" append="off"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:38.968392 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Preparing to wait for external event network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96565693',display_name='tempest-AttachVolumeNegativeTest-server-96565693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-96565693',id=38,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBwCnS4TEOJ5qmgM837AID2NX/mSY4Rim8FvY3X+06hL7JIp0zKerUjC1hVF219b+i0OD49/A+i/0DFreRVrTwKKQMSgOd/3FiLlxRUGJ7WGLQSFnMt2Ralz6gKzTrjUg==',key_name='tempest-keypair-2004684581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-z7m6tom0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=52be42da-de7d-4255-a2d2-84bd69a79605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:38.971369 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:38.972560 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:38.972560 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:38.974810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.974915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:38.975160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:38.976925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.978484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b15715e2-28a0-52c1-bf0e-c0da711ede63', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:38.979590 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.980791 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:38.987294 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.994878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.995085 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2ffb049-b2, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:38.995886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2ffb049-b2, col_values=(('qos', UUID('51247538-2119-41a8-a30b-2b1a88ba515b')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:38.995886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2ffb049-b2, col_values=(('external_ids', {'iface-id': 'a2ffb049-b2a5-4576-9cf1-bc6056029d05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:19:25', 'vm-uuid': '52be42da-de7d-4255-a2d2-84bd69a79605'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:38.997111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:38.998880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:39.010869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.012161 np0000000747 nova-compute[97971]: INFO os_vif [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2')
May 14 04:31:39.064043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:31:39.096581 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:31:39.135005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.138606 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.164675 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.177464 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:39.304843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.328929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.371849 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Successfully updated port: 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:31:39.383650 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:39.415079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:39.415591 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:39.415903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:39.416263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:39.416562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] No waiting events found dispatching network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:39.416731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ae296688-45c5-4f54-9099-84abbdae796b req-3e362aa2-0248-456b-9c91-3a84379de464 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:39.463899 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999447042999918 future=<Future at 0x743618385dc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:39.468001 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:39.468238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing instance network info cache due to event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:39.468590 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:39.468820 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:39.469130 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:39.470650 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] Instance destroyed successfully.
May 14 04:31:39.471854 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid e930721b-9b58-4015-82d0-f492555ce544 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:39.591501 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updated VIF entry in instance network info cache for port a2ffb049-b2a5-4576-9cf1-bc6056029d05. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:31:39.592723 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updating instance_info_cache with network_info: [{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:39.641851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Found WWN 3300000008a0edf56 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:39.642170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:39.642424 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '3300000008a0edf56', 'path': '/dev/dm-7', 'multipath_id': '3300000008a0edf56'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:39.642630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a0edf56', 'path': '/dev/dm-7', 'multipath_id': '3300000008a0edf56'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:39.687044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.149s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:39.689433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.112s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:39.762899 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Deleted allocations for instance 26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949
May 14 04:31:39.876123 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:39.973849 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:39.977149 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1415036733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-1415036733',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:33Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-ogcxqcl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:31:33Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=e930721b-9b58-4015-82d0-f492555ce544,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:39.977149 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "address": "fa:16:3e:da:3b:10", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3241c6b3-ef", "ovs_interfaceid": "3241c6b3-ef44-48e7-bc6c-cf57773edcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:39.980265 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:39.980265 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:39.980757 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.981111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3241c6b3-ef, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:39.984076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:39.992510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.994359 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.994848 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1573c29-c0a7-4eb6-a359-a7df727f9f63) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:39.997967 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:39.997967 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:40.012518 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:40.013988 np0000000747 nova-compute[97971]: INFO os_vif [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:3b:10,bridge_name='br-int',has_traffic_filtering=True,id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3241c6b3-ef')
May 14 04:31:40.071383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:31:40.073151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:31:40.073513 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Creating image(s)
May 14 04:31:40.074651 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:40.075097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:40.075299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:40.075748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:40.075958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:40.078945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:40.079550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:40.079761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:40.086490 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:40.088993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:40.095104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:40.096016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:40.100904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe9af917-5076-4f6f-8355-4f0196dd3895 req-08968463-6f26-4ca6-9e47-7e940332f253 service nova] Releasing lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3 (non-flash)
May 14 04:31:40.119788 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '70')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:40.119788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '70')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:40.121158 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3', '69')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:40.122238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b5ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:40.125635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:40.125635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flush multipath device 330000000ce9fc06f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:40.152691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1055296004',id=36,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:27Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-k33dfdt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:27Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=0a5002bb-852b-4070-a4f7-a34f18aaca4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:22:18:9e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:40.152691 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "vif_mac": "fa:16:3e:22:18:9e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:40.152691 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:40.152691 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:40.178345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:40.237013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:40.298540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:40.298722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:40.300064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:40.317556 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:40.317823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:40.334243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.354929 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:40.376766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.40.100,3260]
May 14 04:31:40.376766 np0000000747 nova-compute[97971]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.40.100,3260] successful.
May 14 04:31:40.376766 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.401335 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.421151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.462643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.50.100,3260]
May 14 04:31:40.462643 np0000000747 nova-compute[97971]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7a1193c4-0b4d-4032-9ea7-91d5085b98d3, portal: 192.168.50.100,3260] successful.
May 14 04:31:40.462643 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.488882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:40.489150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:40.489263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== disconnect_volume: return (413ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:40.489484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:40.490119 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Deleting instance files /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544_del
May 14 04:31:40.490525 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Deletion of /opt/stack/data/nova/instances/e930721b-9b58-4015-82d0-f492555ce544_del complete
May 14 04:31:40.546497 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:40.546664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:40.546736 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:61:19:25, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:40.547268 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Using config drive
May 14 04:31:40.655266 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:40.656349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <uuid>0a5002bb-852b-4070-a4f7-a34f18aaca4f</uuid>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <name>instance-00000024</name>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1055296004</nova:name>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:36</nova:creationTime>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:user uuid="3b73f8491edc4c59b345fbd4d3b6c6b0">tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member</nova:user>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:project uuid="3030a0d75e9c41828981f529272fd47f">tempest-ServerBootFromVolumeStableRescueTest-589525365</nova:project>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         <nova:port uuid="aab5398f-df66-42f8-a56f-30a6adccb675">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="serial">0a5002bb-852b-4070-a4f7-a34f18aaca4f</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="uuid">0a5002bb-852b-4070-a4f7-a34f18aaca4f</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <alias name="ua-d313a9a1-97b5-4351-8cd0-eaddb2bba57c"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-7"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <serial>d313a9a1-97b5-4351-8cd0-eaddb2bba57c</serial>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.rescue"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <boot order="1"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:22:18:9e"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <target dev="tapaab5398f-df"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/console.log" append="off"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:40.656349 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:40.661704 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance destroyed successfully.
May 14 04:31:40.710136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:40.710421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:40.762512 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:40.762718 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:40.774671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-102962b3-22aa-4943-96ab-848244b1d9b6 tempest-TaggedBootDevicesTest_v242-2056355007 tempest-TaggedBootDevicesTest_v242-2056355007-project-member] Lock "26a4e8da-ce6d-4564-9ed3-bd4bbb5c1949" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.233s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:40.802104 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:40.804815 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:40.805377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:40.858024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2890c64a-b114-4ecc-a633-869c13695f2e req-6c1f2b96-3431-4c66-a0fe-1a6c646f459b service nova] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:40.858763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:40.858973 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:40.897039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.part --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:40.897377 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ec2043d3-3da6-418e-aacb-e796c7c4ff10 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:31:40.898900 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:31:40.899222 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.part /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:40.963896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:41.000004 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Took 1.90 seconds to destroy the instance on the hypervisor.
May 14 04:31:41.001265 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:41.001410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:41.001546 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:41.001983 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:41.045420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.part /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.converted" returned: 0 in 0.146s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.051090 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.068925 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:41.079009 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:41.149542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.150232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.054s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:41.150860 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:41.155104 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:41.156731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.215331 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:31:41.258843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.258843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:41.259531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:41.259761 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:41.267814 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:41.273360 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:41.274126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.325444 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Creating config drive at /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.config
May 14 04:31:41.333891 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfo8n5m6b {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.381009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.381009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b,backing_fmt=raw /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.405318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfo8n5m6b" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.452660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b,backing_fmt=raw /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk 1073741824" returned: 0 in 0.072s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.453241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "b9d2ae20973a915ccb01b517ed7c165ec6a7952b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:41.453702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.493647 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:41.504876 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:41.505203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] Acquiring lock "e930721b-9b58-4015-82d0-f492555ce544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:41.505518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:41.505833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] Lock "e930721b-9b58-4015-82d0-f492555ce544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:41.506026 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] No waiting events found dispatching network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:41.506193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0f522e59-551d-4f14-950f-b24a24408134 req-dc4e8ed9-92e9-44de-8d22-1ecc8441cf9e service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-unplugged-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:41.556688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.557192 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:31:41.557411 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:41.593432 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7e2eba9a-9898-4375-9399-97ae58aea6d4 req-62a831a1-705f-4255-ac55-e90c1aae5f22 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Received event network-vif-deleted-3241c6b3-ef44-48e7-bc6c-cf57773edcc8 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:41.593918 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-7e2eba9a-9898-4375-9399-97ae58aea6d4 req-62a831a1-705f-4255-ac55-e90c1aae5f22 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Neutron deleted interface 3241c6b3-ef44-48e7-bc6c-cf57773edcc8; detaching it from the instance and deleting it from the info cache
May 14 04:31:41.595580 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7e2eba9a-9898-4375-9399-97ae58aea6d4 req-62a831a1-705f-4255-ac55-e90c1aae5f22 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:41.670212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:41.670710 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Cannot resize image /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:31:41.671121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:31:41.672721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Ensure instance console log exists: /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:31:41.672721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:41.672721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:41.672721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:41.702277 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:41.783959 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:41.798720 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.111s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:41.800569 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.017s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:41.806151 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:31:41.806350 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Claim successful on node np0000000747
May 14 04:31:41.844068 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:41.857872 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Deleted allocations for instance be285f62-66b7-4e5c-84a6-077afe0a69fb
May 14 04:31:41.877456 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:41.900209 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:41.933278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:41.936657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.032052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.033176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.045700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.102601 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7e2eba9a-9898-4375-9399-97ae58aea6d4 req-62a831a1-705f-4255-ac55-e90c1aae5f22 service nova] [instance: e930721b-9b58-4015-82d0-f492555ce544] Detach interface failed, port_id=3241c6b3-ef44-48e7-bc6c-cf57773edcc8, reason: Instance e930721b-9b58-4015-82d0-f492555ce544 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:42.157577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.194117 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:42.194386 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:42.194550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:42.194722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] No VIF found with MAC fa:16:3e:22:18:9e, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:42.195353 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Using config drive
May 14 04:31:42.346568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:42.347527 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance network_info: |[{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:42.349113 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start _get_guest_xml network_info=[{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:31:28Z,direct_url=<?>,disk_format='qcow2',id=ec2043d3-3da6-418e-aacb-e796c7c4ff10,min_disk=0,min_ram=0,name='tempest-scenario-img--269942493',owner='6495e941aabb4280afd6c384a250e6dd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:31:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': 'ec2043d3-3da6-418e-aacb-e796c7c4ff10'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:42.351824 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:42.353154 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ec2043d3-3da6-418e-aacb-e796c7c4ff10', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1098880331', uuid='dabbc5d1-d4bf-4184-8764-67d80388605d'), owner=OwnerMeta(userid='5673930adce14c6ea2b647e1a339636b', username='tempest-TestMinimumBasicScenario-482942579-project-member', projectid='6495e941aabb4280afd6c384a250e6dd', projectname='tempest-TestMinimumBasicScenario-482942579'), image=ImageMeta(id='ec2043d3-3da6-418e-aacb-e796c7c4ff10', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733102.3527415) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:42.354522 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:42.355189 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:42.356324 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:42.356538 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:42.357656 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:42.357925 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:31:28Z,direct_url=<?>,disk_format='qcow2',id=ec2043d3-3da6-418e-aacb-e796c7c4ff10,min_disk=0,min_ram=0,name='tempest-scenario-img--269942493',owner='6495e941aabb4280afd6c384a250e6dd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:31:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:42.358083 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:42.358183 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:42.358328 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:42.358328 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:42.358517 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:42.358706 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:42.358794 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:42.358914 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:42.359023 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:42.359115 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:42.375804 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:39Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:42.375804 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:42.376846 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:42.377527 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'pci_devices' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:42.381168 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: e930721b-9b58-4015-82d0-f492555ce544] Took 1.38 seconds to deallocate network for instance.
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:42.573278 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-09ca21bf-68ce-44fd-a0f1-d6892fc0f12f req-9a37b7a2-3dcd-4d24-b1a6-c19b1301f457 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state building and task_state spawning.
May 14 04:31:42.698901 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:42.744704 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733102.7441936, 52be42da-de7d-4255-a2d2-84bd69a79605 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:42.744970 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] VM Started (Lifecycle Event)
May 14 04:31:42.880348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0c33e000-9eb7-4f37-86ee-5f630c2d8246 tempest-VolumesSnapshotTestJSON-9761619 tempest-VolumesSnapshotTestJSON-9761619-project-member] Lock "be285f62-66b7-4e5c-84a6-077afe0a69fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.546s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:42.885665 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <uuid>dabbc5d1-d4bf-4184-8764-67d80388605d</uuid>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <name>instance-00000027</name>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestMinimumBasicScenario-server-1098880331</nova:name>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:42</nova:creationTime>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:image uuid="ec2043d3-3da6-418e-aacb-e796c7c4ff10">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:user uuid="5673930adce14c6ea2b647e1a339636b">tempest-TestMinimumBasicScenario-482942579-project-member</nova:user>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:project uuid="6495e941aabb4280afd6c384a250e6dd">tempest-TestMinimumBasicScenario-482942579</nova:project>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="ec2043d3-3da6-418e-aacb-e796c7c4ff10"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         <nova:port uuid="05a7c243-fa8c-42a6-a886-aee31b18a80e">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="serial">dabbc5d1-d4bf-4184-8764-67d80388605d</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="uuid">dabbc5d1-d4bf-4184-8764-67d80388605d</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:dd:c4:26"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <target dev="tap05a7c243-fa"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/console.log" append="off"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:42.885665 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Preparing to wait for external event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:39Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:42.888712 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:42.889285 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:42.889426 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.889727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:42.890461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:42.891782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.892782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48f9390e-bda4-5468-b83e-efcba7d161e7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:42.893962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.894225 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:42.901414 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.904299 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.904504 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05a7c243-fa, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:42.905007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05a7c243-fa, col_values=(('qos', UUID('2d4d359d-cd3a-46c3-a01b-2ecacc92e621')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:42.905182 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05a7c243-fa, col_values=(('external_ids', {'iface-id': '05a7c243-fa8c-42a6-a886-aee31b18a80e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c4:26', 'vm-uuid': 'dabbc5d1-d4bf-4184-8764-67d80388605d'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:42.906199 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.907962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:42.920108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:42.921271 np0000000747 nova-compute[97971]: INFO os_vif [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa')
May 14 04:31:42.950209 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Took 0.57 seconds to detach 1 volumes for instance.
May 14 04:31:43.203678 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:43.203678 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'keypairs' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:43.247665 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:43.249738 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733103.2493937, 52be42da-de7d-4255-a2d2-84bd69a79605 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:43.250411 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] VM Paused (Lifecycle Event)
May 14 04:31:43.456095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:43.579706 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:43.579976 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:43.710153 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:43.712572 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:43.752671 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:43.754401 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:43.824474 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Creating config drive at /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config.rescue
May 14 04:31:43.827366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqpt18qo3 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:43.878776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqpt18qo3" returned: 0 in 0.051s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:44.083083 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:44.256869 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:44.344998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:44.372715 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:44.445421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:44.446696 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:44.446696 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No VIF found with MAC fa:16:3e:dd:c4:26, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:44.446696 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Using config drive
May 14 04:31:44.454589 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:44.465935 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:44.472568 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:44.591423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.791s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:44.593065 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:31:44.596338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.140s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:44.649578 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:44.650317 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Processing event network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:44.651832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:44.652131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:44.652131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] No waiting events found dispatching network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:44.652131 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received unexpected event network-vif-plugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 for instance with vm_state building and task_state spawning.
May 14 04:31:44.652318 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:44.653053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:44.653053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:44.653053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:44.653053 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:44.653570 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dde92b0c-802e-435d-ace7-46f48a410cb3 req-68501cbe-6ce6-4059-89b4-ed41c142df31 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state rescuing.
May 14 04:31:44.653950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:44.657668 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733104.65693, 52be42da-de7d-4255-a2d2-84bd69a79605 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:44.657668 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] VM Resumed (Lifecycle Event)
May 14 04:31:44.659607 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:44.669682 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Instance spawned successfully.
May 14 04:31:44.669682 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:44.953067 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:45.102357 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:31:45.103862 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:31:45.103862 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:45.104513 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:45.112702 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Creating config drive at /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config
May 14 04:31:45.128938 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz999kkhy {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:45.166454 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:45.183148 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:45.192862 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.192987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.195257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.195257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.195257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.195257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:45.204581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz999kkhy" returned: 0 in 0.076s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:45.242736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d6119eb0-4a1c-4638-ab29-fedff2807fa5 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:45.249476 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dbaabfe41f14fa1bcff4d715af5f989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc8341628a343b88c90dd7e5d8e5427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:31:45.289036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:45.291315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:45.575296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:45.575648 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:45.613718 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:31:45.687760 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:45.688179 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 0a5002bb-852b-4070-a4f7-a34f18aaca4f due to new event <LifecycleEvent: 1778733105.687909, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:31:45.688352 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733105.687909, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:45.688578 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Resumed (Lifecycle Event)
May 14 04:31:45.704627 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Took 8.84 seconds to spawn the instance on the hypervisor.
May 14 04:31:45.704808 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:45.764071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:45.803862 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:45.813281 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:45.949478 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:45.967155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:46.014402 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Successfully created port: 55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:31:46.080676 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:46.119378 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:31:46.194526 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:46.195185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:46.196510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:46.200356 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:46.204327 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:46.210025 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.001938515000119878 future=<Future at 0x74363d73c5c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.214524 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Emitting event <LifecycleEvent: 1778733091.2079396, be285f62-66b7-4e5c-84a6-077afe0a69fb => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:46.215764 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.216484 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] VM Stopped (Lifecycle Event)
May 14 04:31:46.217700 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.2610517789998994 future=<Future at 0x74361825ecf0 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.217834 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.2608956770000077 future=<Future at 0x74361825ecf0 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.217918 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.218035 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.243268557999954 future=<Future at 0x743618385dc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.218205 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.243184709999923 future=<Future at 0x743618385dc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:46.220448 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Took 15.10 seconds to build instance.
May 14 04:31:46.233163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:46.591853 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.996s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.687898 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance e930721b-9b58-4015-82d0-f492555ce544
May 14 04:31:46.697424 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Successfully updated port: 55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:31:46.711670 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733106.7113514, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:46.712667 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Started (Lifecycle Event)
May 14 04:31:46.723860 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: be285f62-66b7-4e5c-84a6-077afe0a69fb] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:46.725021 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.615s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.823422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.532s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.906828 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:46.906828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:46.906828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:46.906828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.906828 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:46.907055 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state rescued and task_state unrescuing.
May 14 04:31:46.907103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:46.907520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:46.907520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:46.907766 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.907840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Processing event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:46.908000 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:46.908149 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:46.908297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:46.908429 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:46.908651 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:46.908813 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e4f6f84e-40c5-4d02-934e-15dd899cb074 req-a85506e4-c922-43b0-bf30-03cc23823406 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state building and task_state spawning.
May 14 04:31:46.910485 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:46.915576 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:46.917810 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance spawned successfully.
May 14 04:31:46.918238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:46.943902 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-changed-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:46.944335 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Refreshing instance network info cache due to event network-changed-55aa4c08-878a-45fa-a989-21138711901c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:46.945295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] Acquiring lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:46.945295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] Acquired lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:46.945295 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Refreshing network info cache for port 55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:47.140944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:31:47.140944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:31:47.140944 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Creating image(s)
May 14 04:31:47.140944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:47.140944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:47.141285 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:47.141953 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:47.146201 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:47.147267 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:47.206519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:47.212130 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Unrescuing
May 14 04:31:47.212440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:47.212651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquired lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:47.212867 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:47.217733 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:47.229341 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.132s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk 1073741824" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-changed-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Refreshing instance network info cache due to event network-changed-a2ffb049-b2a5-4576-9cf1-bc6056029d05. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] Acquiring lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] Acquired lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Refreshing network info cache for port a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Cannot resize image /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:31:48.303227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Ensure instance console log exists: /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-893afcfd-faf9-4122-956c-e007d4688f55 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "e930721b-9b58-4015-82d0-f492555ce544" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.124s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733107.7347844, dabbc5d1-d4bf-4184-8764-67d80388605d => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Started (Lifecycle Event)
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Attaching volume c66de25f-45ba-4de8-9192-af413c23740b to /dev/vdb
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Took 7.90 seconds to spawn the instance on the hypervisor.
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fef4:9943', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe61:1925', 'fe80::fc16:3eff:fe22:189e', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad'] 
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating existing volume attachment record: 74bcb372-2412-4196-90d2-de078f748b82 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:48.306124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:48.324343 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [{"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:48.335593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fce5136-4363-4492-9db0-9cffd8cefc4c req-42d0dd2a-bcb9-4798-bef1-0cc4e1b75889 service nova] Releasing lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:48.336332 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquired lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:48.336554 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:31:48.464080 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:48.489732 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Took 16.34 seconds to build instance.
May 14 04:31:48.624751 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updated VIF entry in instance network info cache for port a2ffb049-b2a5-4576-9cf1-bc6056029d05. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:31:48.624751 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updating instance_info_cache with network_info: [{"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:48.673005 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:48.673390 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:48.673600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:48.674149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:48.674788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:48.691243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:48.692776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:48.692776 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:48.692776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:48.692968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:48.693057 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:48.707312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:48.707312 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:48.716032 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:48.716032 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b] added
May 14 04:31:48.724995 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:48.724995 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:48.724995 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:48.731060 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b] added
May 14 04:31:48.731060 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:48.731060 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:48.731060 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:48.731060 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:48.731060 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:48.731060 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:48.731338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:48.731338 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:48.731338 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:48.751053 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733108.75069, dabbc5d1-d4bf-4184-8764-67d80388605d => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:48.751233 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Paused (Lifecycle Event)
May 14 04:31:48.827177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Releasing lock "refresh_cache-0a5002bb-852b-4070-a4f7-a34f18aaca4f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:48.827804 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'flavor' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:48.938964 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:31:48.990655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e6ff0263-34bb-488c-a0f7-84d8d0e113db tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.853s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:49.125830 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f975216b-699b-40af-92d3-baf134055d1a req-9e3f4211-6b71-42a1-9373-8197a0d93673 service nova] Releasing lock "refresh_cache-52be42da-de7d-4255-a2d2-84bd69a79605" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:49.172838 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:49.255383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:49.262476 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733109.2621777, dabbc5d1-d4bf-4184-8764-67d80388605d => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:49.262788 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Resumed (Lifecycle Event)
May 14 04:31:49.372659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:49.377188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:49.412646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:49.436908 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating instance_info_cache with network_info: [{"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:49.558683 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:49.567793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:49.657215 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:49.657692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:49.658058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:49.658058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:49.658230 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:49.658412 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7b16cd10-f474-432c-90c8-ab9a5d757b17 req-544df14c-274c-45cb-bcbb-e9a79c4ef3ae service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state rescued and task_state unrescuing.
May 14 04:31:49.721822 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance destroyed successfully.
May 14 04:31:49.724756 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:49.726131 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:49.732407 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:49.755773 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:49.755773 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:49.755773 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.766304 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:49.772423 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:49.780762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.791229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.802906 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.803207 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.810786 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.811026 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:49.861951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.50.100,3260]
May 14 04:31:49.861951 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.50.100,3260] successful.
May 14 04:31:49.861951 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.867101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.40.100,3260]
May 14 04:31:49.867101 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.40.100,3260] successful.
May 14 04:31:49.867101 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.877091 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.889946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.902184 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.902523 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:49.902523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:49.903116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:49.904441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] HCTL ('9', '-', '-', 0) found on session 71 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:49.904606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:49.917700 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:49.917700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:49.918993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] HCTL ('10', '-', '-', 0) found on session 72 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:49.919570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:49.933670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching for a device in session 71 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:49.933670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:49.940547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Releasing lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:49.947900 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance network_info: |[{"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:31:49.947900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Start _get_guest_xml network_info=[{"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:31:49.949922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching for a device in session 72 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:49.950101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:49.952475 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:31:49.954116 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-2120857660', uuid='d38c474f-806e-4b2f-9a7f-4f25dda0ff88'), owner=OwnerMeta(userid='7dbaabfe41f14fa1bcff4d715af5f989', username='tempest-VolumesBackupsTest-1649149288-project-member', projectid='ffc8341628a343b88c90dd7e5d8e5427', projectname='tempest-VolumesBackupsTest-1649149288'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733109.953592) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:31:49.957413 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:31:49.957911 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:31:49.961504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:31:49.961504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:31:49.961504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:31:49.961836 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:31:49.961836 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:31:49.961939 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:31:49.962060 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:31:49.962116 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:31:49.962258 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:31:49.962354 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:31:49.962484 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:31:49.962603 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:31:49.963192 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:31:49.963192 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:31:49.977874 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2120857660',display_name='tempest-VolumesBackupsTest-instance-2120857660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-2120857660',id=40,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLQ8EdOALVOIAocWLTrESktlt3rCuqwPuFmiZ7X9oCtFfsO9TzmyIyaBQUFBBpbgheZkz13CEpnV2OAng7cTCYkcn0ernYEcIDEMeK6Jo4SCB1dZ9n7u36Lu/74e0XXzg==',key_name='tempest-keypair-1412599027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-z0971mkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=d38c474f-806e-4b2f-9a7f-4f25dda0ff88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:31:49.978132 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:49.978887 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:49.979556 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'pci_devices' on Instance uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:50.227457 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Object Instance<0a5002bb-852b-4070-a4f7-a34f18aaca4f> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:31:50.279218 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999693665999985 future=<Future at 0x7435f84b1130 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:50.482897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] End _get_guest_xml xml=<domain type="qemu">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <uuid>d38c474f-806e-4b2f-9a7f-4f25dda0ff88</uuid>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <name>instance-00000028</name>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesBackupsTest-instance-2120857660</nova:name>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:31:49</nova:creationTime>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:user uuid="7dbaabfe41f14fa1bcff4d715af5f989">tempest-VolumesBackupsTest-1649149288-project-member</nova:user>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:project uuid="ffc8341628a343b88c90dd7e5d8e5427">tempest-VolumesBackupsTest-1649149288</nova:project>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         <nova:port uuid="55aa4c08-878a-45fa-a989-21138711901c">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <system>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="serial">d38c474f-806e-4b2f-9a7f-4f25dda0ff88</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="uuid">d38c474f-806e-4b2f-9a7f-4f25dda0ff88</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </system>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <os>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </os>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <features>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </features>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   <devices>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.config"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </disk>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:91:91:80"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <target dev="tap55aa4c08-87"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </interface>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/console.log" append="off"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </serial>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <video>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </video>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </rng>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:   </devices>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]: </domain>
May 14 04:31:50.482897 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Preparing to wait for external event network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2120857660',display_name='tempest-VolumesBackupsTest-instance-2120857660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-2120857660',id=40,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLQ8EdOALVOIAocWLTrESktlt3rCuqwPuFmiZ7X9oCtFfsO9TzmyIyaBQUFBBpbgheZkz13CEpnV2OAng7cTCYkcn0ernYEcIDEMeK6Jo4SCB1dZ9n7u36Lu/74e0XXzg==',key_name='tempest-keypair-1412599027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-z0971mkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=d38c474f-806e-4b2f-9a7f-4f25dda0ff88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:31:50.487915 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:50.492782 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:50.492782 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:31:50.492782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.492782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:50.493036 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:31:50.493965 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.494059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4134d76-91da-5e08-88d5-64ddc9e8ae5c', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:50.495988 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.495988 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:50.507449 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.512025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.512292 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55aa4c08-87, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:50.513062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55aa4c08-87, col_values=(('qos', UUID('894a0eec-fc3a-4509-9300-7c11918e3ca1')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:50.513328 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55aa4c08-87, col_values=(('external_ids', {'iface-id': '55aa4c08-878a-45fa-a989-21138711901c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:91:80', 'vm-uuid': 'd38c474f-806e-4b2f-9a7f-4f25dda0ff88'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:50.514500 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.517886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:50.529700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.532133 np0000000747 nova-compute[97971]: INFO os_vif [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87')
May 14 04:31:50.696649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:31:50.698784 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.736656 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.778033 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.865638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.885578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.893266 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:50.969566 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.105507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.105916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.106179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.106367 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.106530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:51.110940 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Terminating instance
May 14 04:31:51.173586 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.173800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.614913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:31:51.646444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.650924 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.669234 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-de47372b-5225-4a2b-9532-0a0d68d044b7 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:51.669234 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 0a5002bb-852b-4070-a4f7-a34f18aaca4f due to new event <LifecycleEvent: 1778733111.6676962, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:31:51.669234 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733111.6676962, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:51.669234 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Resumed (Lifecycle Event)
May 14 04:31:51.677480 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:51.683274 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.714548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found WWN 3300000008237a822 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:51.714548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:51.714735 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000008237a822', 'path': '/dev/dm-1', 'multipath_id': '3300000008237a822'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:51.714735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008237a822', 'path': '/dev/dm-1', 'multipath_id': '3300000008237a822'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:51.729210 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:51.744334 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:51.744334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.744334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.744834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:51.744952 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:51.745407 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state rescued and task_state unrescuing.
May 14 04:31:51.745550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:51.745819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.745980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.746100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:51.746462 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:51.746462 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state rescued and task_state unrescuing.
May 14 04:31:51.746723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:51.746782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.748657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.748657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:51.748657 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:51.748657 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-857e80d8-dca5-4d01-bd55-ad4a2f5bd867 req-a5b322cb-bc75-4d0e-bd67-d1d94027197b service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state rescued and task_state unrescuing.
May 14 04:31:51.812505 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.823660 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:51.858881 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:51.858881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:51.858881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:51.858881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:51.859838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:51.859838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-da044ad0-f277-4ac3-8058-97059eaa24e4 req-1ffbcad3-b570-4143-b0c1-4e7b0c321551 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:52.003398 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Instance destroyed successfully.
May 14 04:31:52.003822 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid 85a9913c-942d-4796-86b3-dc12a56ee6fd {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:52.063180 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:52.063439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:52.063781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No VIF found with MAC fa:16:3e:91:91:80, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:52.064432 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Using config drive
May 14 04:31:52.172260 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:52.174653 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:52.226979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Attempting to attach volume c66de25f-45ba-4de8-9192-af413c23740b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:31:52.228246 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:   <alias name="ua-c66de25f-45ba-4de8-9192-af413c23740b"/>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:   <serial>c66de25f-45ba-4de8-9192-af413c23740b</serial>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:52.228246 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:31:52.511845 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=22,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:27Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-v5xvcxo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=85a9913c-942d-4796-86b3-dc12a56ee6fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:52.511845 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "address": "fa:16:3e:f4:99:43", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5be577-bb", "ovs_interfaceid": "6b5be577-bb55-41a2-ae2e-178c3bd132cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:52.515650 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:52.515650 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:52.517162 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.517395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b5be577-bb, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:52.526658 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.528701 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:52.535445 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.537071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.537071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d005c537-39fa-41ea-920d-500db9b4d8bb) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:52.537515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.538124 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:52.546703 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:52.548857 np0000000747 nova-compute[97971]: INFO os_vif [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:43,bridge_name='br-int',has_traffic_filtering=True,id=6b5be577-bb55-41a2-ae2e-178c3bd132cc,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5be577-bb')
May 14 04:31:52.548857 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Deleting instance files /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_del
May 14 04:31:52.557991 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Deletion of /opt/stack/data/nova/instances/85a9913c-942d-4796-86b3-dc12a56ee6fd_del complete
May 14 04:31:52.570572 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:52.676730 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733112.6764147, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:52.677126 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Started (Lifecycle Event)
May 14 04:31:52.691910 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:52.723572 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Creating config drive at /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.config
May 14 04:31:52.728343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3g3fnapu {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:52.784529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3g3fnapu" returned: 0 in 0.056s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:31:52.823650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:52.823878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:52.824203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:52.824289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:52.824465 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:52.829692 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Terminating instance
May 14 04:31:53.067896 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Took 1.45 seconds to destroy the instance on the hypervisor.
May 14 04:31:53.068424 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:53.069059 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:53.069185 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:53.069674 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:53.183366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:53.186601 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:53.233654 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:53.318717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.334039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:31:53.362050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.368094 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.403800 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.538793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.676910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.689975 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] During sync_power_state the instance has a pending task (deleting). Skip.
May 14 04:31:53.690506 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999782681999932 future=<Future at 0x74361bfafdd0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:53.726345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.750135 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.989836298 future=<Future at 0x7435f81fd610 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:53.750135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.750135 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Instance destroyed successfully.
May 14 04:31:53.750135 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 0a5002bb-852b-4070-a4f7-a34f18aaca4f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:53.760999 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.765951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.776107 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.782696 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.807657 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.809015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:53.908775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:53.908775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:53.908775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:31:53.908775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No VIF found with MAC fa:16:3e:10:87:3a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:31:54.001263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:54.005119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Acquiring lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:54.005353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:54.005557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:54.005858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] No waiting events found dispatching network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:54.005858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-unplugged-6b5be577-bb55-41a2-ae2e-178c3bd132cc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:54.006001 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:54.006174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:54.006361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:54.006456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:54.006581 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3aaa23bd-2e9a-4e6d-a8a6-6a9b65df4bb0 req-796e8efe-e5a8-4e8b-8b91-56c70a3b8e33 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Processing event network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:31:54.008788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:54.009594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:54.009594 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attaching volume 703750fc-3974-4b36-a16d-1d5b8ab367f7 to /dev/vdb
May 14 04:31:54.064581 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.066086 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:54.073417 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.083172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:31:54.116036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:31:54.174766 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:31:54.175122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:31:54.188738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:31:54.190853 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fe12:28b5', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe78:d71a', 'fe80::fc16:3eff:fec9:19d4', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feba:fd2b', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe61:1925', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe91:9180', 'fe80::90dc:4aff:fe30:df49'] 
May 14 04:31:54.191092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:31:54.191185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:31:54.191388 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:54.191720 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating existing volume attachment record: b64e0fb2-c0fe-4d1d-87d6-dda56ee06393 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:31:54.230281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.238145 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.252655 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1055296004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1055296004',id=36,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:45Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-k33dfdt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:31:52Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=0a5002bb-852b-4070-a4f7-a34f18aaca4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:31:54.252655 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "aab5398f-df66-42f8-a56f-30a6adccb675", "address": "fa:16:3e:22:18:9e", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab5398f-df", "ovs_interfaceid": "aab5398f-df66-42f8-a56f-30a6adccb675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:31:54.252655 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:31:54.252655 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:31:54.254649 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.254898 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaab5398f-df, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:54.256987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.259079 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:54.260360 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.262793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.263602 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eb16e6c-53b3-48c9-a524-86939f5944d2) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:31:54.265577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.266429 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:31:54.268975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.272160 np0000000747 nova-compute[97971]: INFO os_vif [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:18:9e,bridge_name='br-int',has_traffic_filtering=True,id=aab5398f-df66-42f8-a56f-30a6adccb675,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab5398f-df')
May 14 04:31:54.279179 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:31:54.280179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:54.284812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:54.284812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:54.284812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd313a9a1-97b5-4351-8cd0-eaddb2bba57c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:31:54.284812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:54.322812 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '72')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:31:54.322812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '66')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:54.326136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c', '65')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:31:54.326136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436185ef880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:31:54.326136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:31:54.326136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flush multipath device 3300000008a0edf56 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:31:54.389211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:54.412810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.419310 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:54.430796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:31:54.462132 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0007880000000568543 future=<Future at 0x743618385dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.462998 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Emitting event <LifecycleEvent: 1778733099.4612167, e930721b-9b58-4015-82d0-f492555ce544 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:54.463748 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] VM Stopped (Lifecycle Event)
May 14 04:31:54.466383 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.466627 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.812245957999949 future=<Future at 0x7435f84b1130 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.466830 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.81202112699998 future=<Future at 0x7435f84b1130 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.466915 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.467361 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.223209263999934 future=<Future at 0x74361bfafdd0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.467361 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.223105498999985 future=<Future at 0x74361bfafdd0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:31:54.493735 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:31:54.494181 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:31:54.496049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:31:54.509861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:31:54.510296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:31:54.527174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.576341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.40.100,3260]
May 14 04:31:54.576341 np0000000747 nova-compute[97971]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.40.100,3260] successful.
May 14 04:31:54.576341 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.603990 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.622041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.672908 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.50.100,3260]
May 14 04:31:54.672908 np0000000747 nova-compute[97971]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-d313a9a1-97b5-4351-8cd0-eaddb2bba57c, portal: 192.168.50.100,3260] successful.
May 14 04:31:54.672908 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.698471 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:31:54.698471 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733114.6969383, d38c474f-806e-4b2f-9a7f-4f25dda0ff88 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:54.698471 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] VM Started (Lifecycle Event)
May 14 04:31:54.702014 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:31:54.704949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.705902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:54.706090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== disconnect_volume: return (426ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:54.706587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:31:54.708690 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Deleting instance files /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f_del
May 14 04:31:54.708690 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Deletion of /opt/stack/data/nova/instances/0a5002bb-852b-4070-a4f7-a34f18aaca4f_del complete
May 14 04:31:54.715074 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance spawned successfully.
May 14 04:31:54.716065 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:31:54.726397 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:54.726945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:54.728480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:54.728480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:54.728480 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:54.728480 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-700928f9-4833-41d4-8f3f-86e07d26654d req-d8defab0-20b0-42eb-bb5e-6519581cd308 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:54.775214 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:31:54.775722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:31:54.775916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:54.776385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:54.776797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:31:54.791827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:54.792355 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:31:54.793096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:54.793424 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:54.795973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:31:54.795973 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:54.811052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:54.811052 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.817056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:31:54.817056 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.830941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7] added
May 14 04:31:54.830941 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:54.830941 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:54.830941 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:54.830941 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:54.830941 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:54.830941 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.831277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:54.831538 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:54.831962 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:54.835895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7] added
May 14 04:31:54.835895 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:31:54.835895 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:54.835895 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:54.835895 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:31:54.835895 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:31:54.835895 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:54.836397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:31:54.836397 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0422(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:31:54.836570 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:31:54.967314 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b81c4946-bac7-4358-b89f-cdb93ad9b3e5 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: e930721b-9b58-4015-82d0-f492555ce544] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:55.206407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:55.213003 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:55.225465 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Took 1.89 seconds to destroy the instance on the hypervisor.
May 14 04:31:55.226860 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:31:55.227277 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:31:55.227382 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:31:55.227819 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:55.231298 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.231470 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.231903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.232209 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.232559 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.232912 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:31:55.333783 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:55.375848 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:55.485944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-26a7b79b-da5c-42d3-a34d-580a3d16c0be tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.569s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:55.720123 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:31:55.720608 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733115.7202568, d38c474f-806e-4b2f-9a7f-4f25dda0ff88 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:55.721980 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] VM Paused (Lifecycle Event)
May 14 04:31:55.745081 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Took 8.61 seconds to spawn the instance on the hypervisor.
May 14 04:31:55.746113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:55.790206 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7eeb5df-8139-4ec8-aff7-69b0c5789007 req-aba33b90-2ce6-41f0-ae7a-374234bedb46 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-deleted-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:55.790740 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7eeb5df-8139-4ec8-aff7-69b0c5789007 req-aba33b90-2ce6-41f0-ae7a-374234bedb46 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Neutron deleted interface aab5398f-df66-42f8-a56f-30a6adccb675; detaching it from the instance and deleting it from the info cache
May 14 04:31:55.790900 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7eeb5df-8139-4ec8-aff7-69b0c5789007 req-aba33b90-2ce6-41f0-ae7a-374234bedb46 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:55.832315 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:31:55.837132 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:55.851778 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:55.851778 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:31:55.864679 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:31:55.864679 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.877840 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.878417 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Took 2.81 seconds to deallocate network for instance.
May 14 04:31:55.887112 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.900373 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.911360 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:55.911778 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:55.954782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260]
May 14 04:31:55.954782 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260] successful.
May 14 04:31:55.954782 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.965052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260]
May 14 04:31:55.965052 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260] successful.
May 14 04:31:55.965052 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.973673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.982901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:31:55.985832 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.004035 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.004850 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:56.007196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:56.007196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:56.007196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('13', '-', '-', 0) found on session 73 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:56.007196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.012857 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:31:56.013255 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:31:56.013255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:56.013666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:31:56.016729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('14', '-', '-', 0) found on session 74 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:31:56.016729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:31:56.040581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 73 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:56.040581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:56.040828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 74 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:31:56.040994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:31:56.115385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.119303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.119303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.119303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.119303 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] No waiting events found dispatching network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.119303 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5eb4f8b0-7a2f-44a0-9a72-161c5068c5c2 req-8cdc09dc-86ea-4668-b346-1f1dc6d7e6c7 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received unexpected event network-vif-plugged-55aa4c08-878a-45fa-a989-21138711901c for instance with vm_state active and task_state None.
May 14 04:31:56.196746 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:56.229232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:56.234887 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733116.2344692, d38c474f-806e-4b2f-9a7f-4f25dda0ff88 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:31:56.235399 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] VM Resumed (Lifecycle Event)
May 14 04:31:56.263152 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Took 14.54 seconds to build instance.
May 14 04:31:56.286586 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:56.299399 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7eeb5df-8139-4ec8-aff7-69b0c5789007 req-aba33b90-2ce6-41f0-ae7a-374234bedb46 service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Detach interface failed, port_id=aab5398f-df66-42f8-a56f-30a6adccb675, reason: Instance 0a5002bb-852b-4070-a4f7-a34f18aaca4f could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:31:56.388788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.389073 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.701594 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Took 1.47 seconds to deallocate network for instance.
May 14 04:31:56.739092 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:31:56.745103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:31:56.765740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.055s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.796438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:31:56.859347 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Received event network-vif-deleted-6b5be577-bb55-41a2-ae2e-178c3bd132cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.860005 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.860005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.860475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.860806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state deleting.
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received unexpected event network-vif-plugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with vm_state active and task_state deleting.
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.863772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.865236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.865236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.865236 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.865236 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:56.865341 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:56.865484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Acquiring lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:56.865690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:56.865966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:56.866552 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] No waiting events found dispatching network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:31:56.866631 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b7bdc12-19a6-4880-b4ff-5796b7d7fbaf req-34284d69-45f0-4c17-aebc-25a14790b0ff service nova] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Received event network-vif-unplugged-aab5398f-df66-42f8-a56f-30a6adccb675 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:31:57.311561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Took 0.61 seconds to detach 1 volumes for instance.
May 14 04:31:57.319608 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Deleting volume: d313a9a1-97b5-4351-8cd0-eaddb2bba57c {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:31:57.456656 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:57.456878 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:57.830272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found WWN 3300000009ef5ae9c for multipath device dm-5 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:31:57.830272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:31:57.830272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '3300000009ef5ae9c', 'path': '/dev/dm-5', 'multipath_id': '3300000009ef5ae9c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:31:57.830272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009ef5ae9c', 'path': '/dev/dm-5', 'multipath_id': '3300000009ef5ae9c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:31:57.838345 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:31:57.902405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:57.963115 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:31:57.979817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-changed-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:31:57.979817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Refreshing instance network info cache due to event network-changed-55aa4c08-878a-45fa-a989-21138711901c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:31:57.979817 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] Acquiring lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:31:57.979817 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] Acquired lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:31:57.979817 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Refreshing network info cache for port 55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:31:58.341851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attempting to attach volume 703750fc-3974-4b36-a16d-1d5b8ab367f7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:31:58.343455 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:   <alias name="ua-703750fc-3974-4b36-a16d-1d5b8ab367f7"/>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:   <serial>703750fc-3974-4b36-a16d-1d5b8ab367f7</serial>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]: </disk>
May 14 04:31:58.343455 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:31:58.476804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.088s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:58.478423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.575s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:58.483293 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:58.601196 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance 85a9913c-942d-4796-86b3-dc12a56ee6fd
May 14 04:31:58.970551 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:31:59.221565 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updated VIF entry in instance network info cache for port 55aa4c08-878a-45fa-a989-21138711901c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:31:59.222069 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating instance_info_cache with network_info: [{"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:31:59.269584 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:59.511524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:31:59.574711 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:31:59.575230 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:31:59.618645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f1d67e37-6eb4-4c79-9d82-b33ecd97212b tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "85a9913c-942d-4796-86b3-dc12a56ee6fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:59.724962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92a7ae40-ae60-4dbd-96c2-6867e32df10c req-7a85c3a0-bc8a-446f-88aa-82118ddeed13 service nova] Releasing lock "refresh_cache-d38c474f-806e-4b2f-9a7f-4f25dda0ff88" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "3370940d-3bd7-45f3-887f-9c515137a348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:31:59.938897 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Terminating instance
May 14 04:32:00.066205 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:00.066776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:00.066776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:00.066776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No VIF found with MAC fa:16:3e:dd:c4:26, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:00.078142 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:00.443640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:00.483293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.486509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.520488 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.590692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.113s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:00.688388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.698005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.700933 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Deleted allocations for instance 0a5002bb-852b-4070-a4f7-a34f18aaca4f
May 14 04:32:00.781795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.790896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:00.819083 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999667297000087 future=<Future at 0x74361bf8b1d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:00.820460 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Instance destroyed successfully.
May 14 04:32:00.821026 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid 3370940d-3bd7-45f3-887f-9c515137a348 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:00.989517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:01.122026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:01.122469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:01.324118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=20,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:33Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-pug2xl5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=3370940d-3bd7-45f3-887f-9c515137a348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:01.324118 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "address": "fa:16:3e:78:d7:1a", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ffd091-d1", "ovs_interfaceid": "79ffd091-d1b4-40f2-a837-e3aea3edff11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:01.325482 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:01.325978 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:01.326907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:01.327192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79ffd091-d1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:01.330341 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:01.331630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:01.332400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:01.332607 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9feef903-72f3-438f-9c2b-4bee51483568) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:01.335434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:01.337289 np0000000747 nova-compute[97971]: INFO os_vif [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d7:1a,bridge_name='br-int',has_traffic_filtering=True,id=79ffd091-d1b4-40f2-a837-e3aea3edff11,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ffd091-d1')
May 14 04:32:01.337589 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Deleting instance files /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_del
May 14 04:32:01.351492 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Deletion of /opt/stack/data/nova/instances/3370940d-3bd7-45f3-887f-9c515137a348_del complete
May 14 04:32:01.602490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:01.626224 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Detaching volume c66de25f-45ba-4de8-9192-af413c23740b
May 14 04:32:01.637045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f0e3c3b0-8202-4fe7-885e-bb6450f17827 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.628s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:01.701291 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Attempting to driver detach volume c66de25f-45ba-4de8-9192-af413c23740b from mountpoint /dev/vdb
May 14 04:32:01.714835 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found disk vdb by alias ua-c66de25f-45ba-4de8-9192-af413c23740b {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:32:01.716301 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found disk vdb by alias ua-c66de25f-45ba-4de8-9192-af413c23740b {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:32:01.716301 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Attempting to detach device vdb from instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:32:01.716819 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <alias name="ua-c66de25f-45ba-4de8-9192-af413c23740b"/>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <serial>c66de25f-45ba-4de8-9192-af413c23740b</serial>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]: </disk>
May 14 04:32:01.716819 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:32:01.718804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f19a06d3-f7dc-4d4c-9a88-d03782ece718 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "0a5002bb-852b-4070-a4f7-a34f18aaca4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.895s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:01.729343 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully detached device vdb from instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa from the persistent domain config.
May 14 04:32:01.729457 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] (1/8): Attempting to detach device vdb with device alias ua-c66de25f-45ba-4de8-9192-af413c23740b from instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:32:01.731736 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <alias name="ua-c66de25f-45ba-4de8-9192-af413c23740b"/>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <serial>c66de25f-45ba-4de8-9192-af413c23740b</serial>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]: </disk>
May 14 04:32:01.731736 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:32:01.872375 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Took 1.43 seconds to destroy the instance on the hypervisor.
May 14 04:32:01.873950 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:01.874685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:01.874855 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:01.875151 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:02.055694 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:02.422202 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c66de25f-45ba-4de8-9192-af413c23740b for instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:32:02.423423 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733122.4230406, 5c037683-9726-4c1e-b4eb-d41e0155d9fa => ua-c66de25f-45ba-4de8-9192-af413c23740b> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:32:02.433395 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully detached device vdb from instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa from the live domain config.
May 14 04:32:02.437888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:02.437888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:02.438072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:02.438918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:02.439910 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c66de25f-45ba-4de8-9192-af413c23740b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:02.441751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:02.485675 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:02.486411 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '74')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:02.486411 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '72')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:02.488552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b', '71')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:02.489059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184cd3a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:02.489602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:02.489602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flush multipath device 3300000008237a822 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:02.526392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:02.571198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:02.601944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-371e3cb4-dd13-42b9-acb0-26a741578237 req-24da34d4-a048-4e89-bc06-4403a87dc7f8 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Received event network-vif-deleted-79ffd091-d1b4-40f2-a837-e3aea3edff11 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:02.602276 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-371e3cb4-dd13-42b9-acb0-26a741578237 req-24da34d4-a048-4e89-bc06-4403a87dc7f8 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Neutron deleted interface 79ffd091-d1b4-40f2-a837-e3aea3edff11; detaching it from the instance and deleting it from the info cache
May 14 04:32:02.602276 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-371e3cb4-dd13-42b9-acb0-26a741578237 req-24da34d4-a048-4e89-bc06-4403a87dc7f8 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:02.629808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:02.629994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:02.633358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:02.648059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:02.648252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:02.656989 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:02.657270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:02.657498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:02.657697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:02.657894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:02.660954 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Terminating instance
May 14 04:32:02.670209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.725082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.40.100,3260]
May 14 04:32:02.725082 np0000000747 nova-compute[97971]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.40.100,3260] successful.
May 14 04:32:02.725082 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.757450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.777076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.832130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.50.100,3260]
May 14 04:32:02.832130 np0000000747 nova-compute[97971]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-c66de25f-45ba-4de8-9192-af413c23740b, portal: 192.168.50.100,3260] successful.
May 14 04:32:02.832130 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.857980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:02.858442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:02.858442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== disconnect_volume: return (420ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:02.858552 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:03.012663 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:03.112974 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-371e3cb4-dd13-42b9-acb0-26a741578237 req-24da34d4-a048-4e89-bc06-4403a87dc7f8 service nova] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Detach interface failed, port_id=79ffd091-d1b4-40f2-a837-e3aea3edff11, reason: Instance 3370940d-3bd7-45f3-887f-9c515137a348 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:03.169383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:03.197858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:03.227566 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:03.370263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:03.378739 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:03.446998 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:03.515770 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Took 1.64 seconds to deallocate network for instance.
May 14 04:32:03.527684 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999719736000088 future=<Future at 0x74361828b290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:03.531137 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Instance destroyed successfully.
May 14 04:32:03.531933 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 8860392d-b13e-43fe-9f11-b8800d1ba6fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:04.025432 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:04.025584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:04.035472 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2137749004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-2137749004',id=33,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:49Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-qh6e5lij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:58Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=8860392d-b13e-43fe-9f11-b8800d1ba6fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:04.038422 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "d10bc415-5b89-44df-a03b-f212a0abcddd", "address": "fa:16:3e:ba:fd:2b", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10bc415-5b", "ovs_interfaceid": "d10bc415-5b89-44df-a03b-f212a0abcddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:04.039392 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:04.039668 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:04.040912 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:04.041140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd10bc415-5b, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:04.042578 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:04.046550 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:04.047680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:04.047680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4afa591f-540b-4994-ad7c-620c13c6e126) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:04.051198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:04.052393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:04.053527 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:04.056120 np0000000747 nova-compute[97971]: INFO os_vif [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:2b,bridge_name='br-int',has_traffic_filtering=True,id=d10bc415-5b89-44df-a03b-f212a0abcddd,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10bc415-5b')
May 14 04:32:04.056426 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Deleting instance files /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa_del
May 14 04:32:04.058025 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Deletion of /opt/stack/data/nova/instances/8860392d-b13e-43fe-9f11-b8800d1ba6fa_del complete
May 14 04:32:04.453991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b85bb910-70d1-483a-9ddc-af59b5f1cd2b tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.332s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:04.567417 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:32:04.568352 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:04.570066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:04.570066 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:04.570066 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:04.668553 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:04.847652 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:04.848327 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:04.886383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:04.888929 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing instance network info cache due to event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:04.888929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:04.888929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:04.889290 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:05.229263 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-624df8a5-258e-4022-b696-85ebfaf2b784 req-52479b54-c226-4d96-9b6f-ce4dba64a159 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Received event network-vif-deleted-d10bc415-5b89-44df-a03b-f212a0abcddd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:05.231649 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-624df8a5-258e-4022-b696-85ebfaf2b784 req-52479b54-c226-4d96-9b6f-ce4dba64a159 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Neutron deleted interface d10bc415-5b89-44df-a03b-f212a0abcddd; detaching it from the instance and deleting it from the info cache
May 14 04:32:05.231649 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-624df8a5-258e-4022-b696-85ebfaf2b784 req-52479b54-c226-4d96-9b6f-ce4dba64a159 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:05.351889 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:05.393092 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:05.555362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:05.555876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:05.628891 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:05.735573 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-624df8a5-258e-4022-b696-85ebfaf2b784 req-52479b54-c226-4d96-9b6f-ce4dba64a159 service nova] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Detach interface failed, port_id=d10bc415-5b89-44df-a03b-f212a0abcddd, reason: Instance 8860392d-b13e-43fe-9f11-b8800d1ba6fa could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:05.864369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.837s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:05.934343 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:05.970713 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance 3370940d-3bd7-45f3-887f-9c515137a348
May 14 04:32:05.989878 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:06.057912 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:32:06.132676 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Took 1.56 seconds to deallocate network for instance.
May 14 04:32:06.154946 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updated VIF entry in instance network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:32:06.155646 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:06.645490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:06.645869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:06.648290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:06.657780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de0f1732-524f-46e5-a676-a933d6d780ad req-7deb908a-d1f1-43d8-934d-60857445cfa1 service nova] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:06.982873 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcf4b565-b58b-4219-ab3c-30360e905e1e tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "3370940d-3bd7-45f3-887f-9c515137a348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:07.456691 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:07.506019 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:07.506019 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:07.850502 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:07.852192 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing instance network info cache due to event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:07.852192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:07.852192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:07.852192 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:08.009928 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:08.153362 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:08.356176 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:08.520148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.874s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:08.522302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.872s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:08.526326 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:32:08.526516 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Claim successful on node np0000000747
May 14 04:32:08.617558 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Deleted allocations for instance 8860392d-b13e-43fe-9f11-b8800d1ba6fa
May 14 04:32:08.662561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] instance snapshotting
May 14 04:32:08.690687 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003886900001361937 future=<Future at 0x74361bfafdd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.690810 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.690890 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.03899870300006114 future=<Future at 0x7435f81fd610 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.691002 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.038886023000031855 future=<Future at 0x7435f81fd610 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.692474 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Emitting event <LifecycleEvent: 1778733113.6901898, 85a9913c-942d-4796-86b3-dc12a56ee6fd => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:08.692757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] VM Stopped (Lifecycle Event)
May 14 04:32:08.730293 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003317230000448035 future=<Future at 0x7435f81fd610 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.730370 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.730486 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.087316973000043 future=<Future at 0x74361bf8b1d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.730825 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.087229380000053 future=<Future at 0x74361bf8b1d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:08.732086 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733113.729829, 0a5002bb-852b-4070-a4f7-a34f18aaca4f => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:08.732086 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] VM Stopped (Lifecycle Event)
May 14 04:32:08.805953 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Beginning live snapshot process
May 14 04:32:08.816014 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:08.829570 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:08.829877 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:08.830090 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:08.830271 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:08.830362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:08.833270 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Terminating instance
May 14 04:32:09.036280 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updated VIF entry in instance network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:32:09.036842 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:09.048246 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.196055 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 85a9913c-942d-4796-86b3-dc12a56ee6fd] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:09.237359 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 0a5002bb-852b-4070-a4f7-a34f18aaca4f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:09.338259 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:09.369130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.376502 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.401660 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.522283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.529501 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:09.540454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9acfaf1d-97a3-4ab8-b805-903e361c1a97 req-fdb4a70f-9a81-44ea-b2d2-016fbdc13a9e service nova] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:09.629593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-411d729f-d96d-48fa-852b-872eac11d468 tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "8860392d-b13e-43fe-9f11-b8800d1ba6fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.972s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:09.674397 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99971212100013 future=<Future at 0x7435f8566150 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:09.677272 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Instance destroyed successfully.
May 14 04:32:09.677629 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid 5d42ebce-6d76-4893-b335-bceb7181a83a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] No waiting events found dispatching network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:09.993470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-31ac0d7d-cbce-494d-b138-a5982222d061 req-8c5fd63b-1371-42c6-8ae2-08e958803002 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:10.181147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-1',id=17,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:29Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-c0cmilx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=5d42ebce-6d76-4893-b335-bceb7181a83a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:10.181903 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "address": "fa:16:3e:12:28:b5", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e8226a-fe", "ovs_interfaceid": "e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:10.182781 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:10.183273 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:10.184682 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.185586 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e8226a-fe, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:10.187907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.189337 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:10.190154 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.190905 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fece2afb-31b7-48a9-bcc5-1a0ddfae71da) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:10.192944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:10.193637 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.197902 np0000000747 nova-compute[97971]: INFO os_vif [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:28:b5,bridge_name='br-int',has_traffic_filtering=True,id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e8226a-fe')
May 14 04:32:10.197902 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Deleting instance files /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a_del
May 14 04:32:10.198494 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Deletion of /opt/stack/data/nova/instances/5d42ebce-6d76-4893-b335-bceb7181a83a_del complete
May 14 04:32:10.242141 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:10.242554 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:10.325031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:10.389731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:10.389731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:10.389731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:10.389731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:10.389731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:10.394688 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Terminating instance
May 14 04:32:10.431433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:10.432030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json -f qcow2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:10.535557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:10.536661 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:10.539277 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:10.539757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:10.611845 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:10.613169 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 04:32:10.649379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:10.652193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847.delta 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:10.712059 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 04:32:10.713138 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:10.716646 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:10.716646 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:10.716646 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:10.722692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847.delta 1073741824" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:10.723132 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Quiescing instance not available: QEMU guest agent is not enabled.
May 14 04:32:10.745751 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:10.849337 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:10.904059 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:10.943694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.945545 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.975668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:10.995040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.084896 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] COPY block job progress, current cursor: 524288 final cursor: 76742656 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:32:11.119070 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:11.124374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.133877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.257658 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.737s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:11.257658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:32:11.265643 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.299767 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999361104999934 future=<Future at 0x743618229460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:11.305108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.313783 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab68cd8e-613d-4ef6-8817-85020e5d3468 req-f4b5b241-531a-4eed-bdc1-a56c5b852fb9 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-deleted-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:11.313943 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-ab68cd8e-613d-4ef6-8817-85020e5d3468 req-f4b5b241-531a-4eed-bdc1-a56c5b852fb9 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Neutron deleted interface e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2; detaching it from the instance and deleting it from the info cache
May 14 04:32:11.314171 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab68cd8e-613d-4ef6-8817-85020e5d3468 req-f4b5b241-531a-4eed-bdc1-a56c5b852fb9 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:11.317827 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Instance destroyed successfully.
May 14 04:32:11.318215 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:11.328301 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.425765 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.434199 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.536011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.581224 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.590250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.593110 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=97971) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 14 04:32:11.596329 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Skipping quiescing instance: QEMU guest agent is not enabled.
May 14 04:32:11.642729 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:32:11.642729 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847.delta /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:11.721652 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:11.777182 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:32:11.777418 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:32:11.778155 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:11.778715 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:11.823037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab68cd8e-613d-4ef6-8817-85020e5d3468 req-f4b5b241-531a-4eed-bdc1-a56c5b852fb9 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Detach interface failed, port_id=e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2, reason: Instance 5d42ebce-6d76-4893-b335-bceb7181a83a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:11.825732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1799627014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1799627014',id=30,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-ofsjtxma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:30Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=5faa3a7e-8ade-4e0b-9568-465fc7c61dcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:11.826098 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "address": "fa:16:3e:c9:19:d4", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed5d49e-dc", "ovs_interfaceid": "7ed5d49e-dce2-42e3-8dbc-7b130844d6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:11.827715 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:11.828276 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:11.830885 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.831287 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ed5d49e-dc, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:11.836115 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:11.837109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.837255 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82528455-50c4-4abe-97cf-0332d83d83b7) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:11.837886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.838399 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:11.840553 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:11.842763 np0000000747 nova-compute[97971]: INFO os_vif [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:19:d4,bridge_name='br-int',has_traffic_filtering=True,id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed5d49e-dc')
May 14 04:32:11.844872 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:11.845338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:11.845545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:11.846116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:11.847511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6f5a8a9-da9a-4850-af03-e9b361fdd494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:11.847828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:11.865980 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e18a4a18a9c458b90e48fa022b5e13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ca6721021640418a98b959a677f8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:11.889093 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:11.889485 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:11.889738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '74')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:11.889738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '57')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:11.891583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494', '58')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:11.893312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361827b420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'): ({'sdm'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:11.893668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Removing multipathed devices sdm, sdl {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:11.894059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Flush multipath device 3300000008e2a4ac0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:11.926470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847.delta /opt/stack/data/nova/instances/snapshots/tmpyh1904hk/14d7456edb7046f4ad452631e149e847" returned: 0 in 0.284s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:11.934276 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Snapshot extracted, beginning image upload
May 14 04:32:11.948055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:12.009504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:12.063571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:12.063824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:12.065706 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:12.080752 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:12.081193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:12.094750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.122111 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] No waiting events found dispatching network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Received event network-vif-unplugged-e4e8226a-fe91-406d-a4b4-e3b5cd41e2e2 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.123644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.124023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.124433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.124794 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.125088 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:12.125345 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.125734 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.126394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.126394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.127398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.127398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:12.127398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.127398 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.128709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.128709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.128709 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.129055 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state active and task_state deleting.
May 14 04:32:12.129302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.129559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received unexpected event network-vif-plugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with vm_state active and task_state deleting.
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:12.131406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8ee0c44-6b02-4ebc-80e3-d9fa96e23f10 req-f3413238-8241-4689-a555-0ab410ab6843 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:12.133626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.40.100,3260]
May 14 04:32:12.133626 np0000000747 nova-compute[97971]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.40.100,3260] successful.
May 14 04:32:12.133626 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.151339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.164202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.196870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.50.100,3260]
May 14 04:32:12.196870 np0000000747 nova-compute[97971]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-e6f5a8a9-da9a-4850-af03-e9b361fdd494, portal: 192.168.50.100,3260] successful.
May 14 04:32:12.196870 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.215221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:12.215592 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:12.215900 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] <== disconnect_volume: return (370ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:12.216089 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:12.216489 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Deleting instance files /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc_del
May 14 04:32:12.217197 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Deletion of /opt/stack/data/nova/instances/5faa3a7e-8ade-4e0b-9568-465fc7c61dcc_del complete
May 14 04:32:12.229453 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Took 1.52 seconds to deallocate network for instance.
May 14 04:32:12.282414 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:32:12.736909 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Took 1.83 seconds to destroy the instance on the hypervisor.
May 14 04:32:12.737574 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:12.737803 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:12.737895 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:12.738151 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:12.742125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:12.742295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:12.789498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:32:12.848721 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:13.091521 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Successfully created port: 7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:32:13.118834 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:13.118834 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 04:32:13.232626 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-444b7ccf-7c97-4e59-b3ed-ae8648879671 req-9c9f00f2-497b-4550-b9a2-7f727edb7188 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-deleted-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:13.233381 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-444b7ccf-7c97-4e59-b3ed-ae8648879671 req-9c9f00f2-497b-4550-b9a2-7f727edb7188 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Neutron deleted interface 7ed5d49e-dce2-42e3-8dbc-7b130844d6d1; detaching it from the instance and deleting it from the info cache
May 14 04:32:13.233663 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-444b7ccf-7c97-4e59-b3ed-ae8648879671 req-9c9f00f2-497b-4550-b9a2-7f727edb7188 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:13.294102 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Booting with volume 46977d6c-2c67-43ce-a101-9ed5481c354a at /dev/vda
May 14 04:32:13.356597 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:13.373965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:32:13.412150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:13.488873 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:32:13.488971 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:32:13.503223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:32:13.504792 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feac:2f49', 'fe80::dcba:c4ff:fecf:9202', 'fe80::fc16:3eff:fedb:647f', 'fe80::fc16:3eff:fea4:7f5f', 'fe80::9417:43ff:feec:7ddf', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe61:1925', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe91:9180', 'fe80::90dc:4aff:fe30:df49'] 
May 14 04:32:13.505134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:32:13.505134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:32:13.505487 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:13.505822 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating existing volume attachment record: 9730c188-2334-472a-a40b-d819b08b76d2 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:32:13.540940 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:13.540940 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:13.623113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] There are 0 instances to clean {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 04:32:13.623861 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:13.667535 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:13.739113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-444b7ccf-7c97-4e59-b3ed-ae8648879671 req-9c9f00f2-497b-4550-b9a2-7f727edb7188 service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Detach interface failed, port_id=7ed5d49e-dce2-42e3-8dbc-7b130844d6d1, reason: Instance 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:13.798373 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Successfully updated port: 7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:32:13.854672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-changed-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:13.856312 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Refreshing instance network info cache due to event network-changed-7a85c8c7-f3d6-4104-8047-287669c598a5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:13.856571 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] Acquiring lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:13.856728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] Acquired lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:13.857282 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Refreshing network info cache for port 7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:14.045394 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:14.170389 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Took 1.43 seconds to deallocate network for instance.
May 14 04:32:14.196693 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:14.198145 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] Acquiring lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:14.198363 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:14.198518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:14.198701 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] No waiting events found dispatching network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:14.198873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c09a7a7f-e1fd-4f5c-8f27-238030e2a288 req-76e2bf5a-c631-473a-8321-d441c2e44d6c service nova] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Received event network-vif-unplugged-7ed5d49e-dce2-42e3-8dbc-7b130844d6d1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:14.299562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:14.360460 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:14.443567 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:14.552790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.810s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:14.631795 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance 5d42ebce-6d76-4893-b335-bceb7181a83a
May 14 04:32:14.694048 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:14.746526 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Took 0.58 seconds to detach 1 volumes for instance.
May 14 04:32:14.752756 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Deleting volume: e6f5a8a9-da9a-4850-af03-e9b361fdd494 {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:32:14.997605 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Snapshot image upload complete
May 14 04:32:14.997901 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d92f57e0-9660-4fcd-b218-e59b30a65047 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Took 6.33 seconds to snapshot the instance on the hypervisor.
May 14 04:32:15.080382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:15.197790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e938b2ae-fd83-45f2-9061-2ba25cf1e1c1 req-1bbb9a55-23c9-43c5-a69f-b103f0666a03 service nova] Releasing lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:15.198097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquired lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:15.198738 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:15.324368 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:15.324866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:15.650011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d66400e3-c50c-4765-8768-074ec16af046 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "5d42ebce-6d76-4893-b335-bceb7181a83a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.820s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:15.676918 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:32:15.678897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:32:15.679384 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating image(s)
May 14 04:32:15.679838 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:32:15.680055 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Ensure instance console log exists: /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:32:15.680397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:15.680980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:15.681744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:15.818377 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004896519999419979 future=<Future at 0x74361bf8b1d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:15.819151 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Emitting event <LifecycleEvent: 1778733120.817728, 3370940d-3bd7-45f3-887f-9c515137a348 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:15.820095 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:15.820095 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.7076031760000205 future=<Future at 0x74361828b290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:15.820095 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.7074762990000636 future=<Future at 0x74361828b290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:15.820095 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] VM Stopped (Lifecycle Event)
May 14 04:32:15.842826 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:15.998155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:16.049667 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:16.050005 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:16.115926 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:16.116332 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:16.156605 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:16.323030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 3370940d-3bd7-45f3-887f-9c515137a348] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:16.423164 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:16.423557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:16.423557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:16.423778 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:16.423935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:16.429912 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating instance_info_cache with network_info: [{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:16.431133 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Terminating instance
May 14 04:32:16.555503 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:16.610040 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:16.610491 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:16.838891 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:16.932201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Releasing lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:16.932634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance network_info: |[{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:32:16.933972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start _get_guest_xml network_info=[{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9730c188-2334-472a-a40b-d819b08b76d2', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '78a47990-a6d1-4617-8c1c-538889b9f34a', 'attached_at': '', 'detached_at': '', 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'serial': '46977d6c-2c67-43ce-a101-9ed5481c354a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:16.937667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:16.939293 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:16.941188 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-242034707', uuid='78a47990-a6d1-4617-8c1c-538889b9f34a'), owner=OwnerMeta(userid='4e18a4a18a9c458b90e48fa022b5e13c', username='tempest-ServerActionsV293TestJSON-1284155576-project-member', projectid='d8ca6721021640418a98b959a677f8a0', projectname='tempest-ServerActionsV293TestJSON-1284155576'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733136.9403884) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:16.941188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:16.941188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:16.941188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:16.944396 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:16.945664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:16.945916 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:16.946165 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:16.946282 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:16.946474 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:16.946676 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:16.946798 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:16.947042 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:16.947182 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:16.947295 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:16.947412 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:16.948535 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:16.962092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:16.967343 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:32:16.967809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:16.970283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:16.970283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:16.970508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:32:16.970842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:16.987081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:16.987555 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:16.988665 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:16.988790 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:16.990188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:16.990188 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:16.993493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.005811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:17.005811 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:17.007626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:17.007626 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a] added
May 14 04:32:17.023322 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:17.023322 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:17.023322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:17.023843 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:17.023843 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:17.024646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a] added
May 14 04:32:17.024646 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:17.024646 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:17.024646 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:17.024646 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:17.024646 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:17.024646 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:17.024919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:17.024973 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:17.025136 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:17.065343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.741s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:17.121783 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.128948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.151094 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Deleted allocations for instance 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc
May 14 04:32:17.156890 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:17.157128 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:17.158930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:17.158930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:17.158930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:17.159371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-efe54fb7-7238-4a91-9996-d7f92e54a7a5 req-5851610f-4f6e-4d70-92b6-ef53b3e7370a service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:17.278082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.292666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.324482 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999628494000035 future=<Future at 0x7435f8475040 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:17.324482 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Instance destroyed successfully.
May 14 04:32:17.324482 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:17.339975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.346609 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.366800 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.465667 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.471929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.499299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:17.499520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:17.602033 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:17.602417 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:17.627217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.634510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.827221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='multiattach-server-0',id=13,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WZiUy0EpWDDjmE4AmHlbkNM5kYiISBy0neey36DNgh3DzgXVv6dQLvKM39Lb4Utrz8CpmhmogoFWR87aHCLmIIE7pqXHoZnKBk1JqPnCezgf0KR7IBiYYBJrM5uwcPQ==',key_name='tempest-keypair-219654470',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:27:07Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-508hzxs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c46830061c284ed38642cf66db196b0d',uuid=9ab87dcf-3d40-4cfe-812d-bc19d06f3270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:17.828255 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "c8645ad6-8a83-4f7b-8466-37d93e660471", "address": "fa:16:3e:db:64:7f", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8645ad6-8a", "ovs_interfaceid": "c8645ad6-8a83-4f7b-8466-37d93e660471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:17.828936 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:17.829677 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:17.830859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.831132 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8645ad6-8a, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:17.833708 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:17.834498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.834832 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f385efb-aaa9-42c0-970b-0dc2115d0c89) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:17.836256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:17.836256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:17.837842 np0000000747 nova-compute[97971]: INFO os_vif [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:64:7f,bridge_name='br-int',has_traffic_filtering=True,id=c8645ad6-8a83-4f7b-8466-37d93e660471,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8645ad6-8a')
May 14 04:32:17.838288 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Deleting instance files /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270_del
May 14 04:32:17.839342 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Deletion of /opt/stack/data/nova/instances/9ab87dcf-3d40-4cfe-812d-bc19d06f3270_del complete
May 14 04:32:18.001736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:32:18.024182 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:18.028077 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:18.039780 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:18.039780 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:18.046940 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:18.046940 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.056223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.062043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.075839 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.076075 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.082310 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.082469 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:18.120840 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260]
May 14 04:32:18.120840 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260] successful.
May 14 04:32:18.120840 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.125450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260]
May 14 04:32:18.125450 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260] successful.
May 14 04:32:18.125450 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.132570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.140466 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.152120 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.152383 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:18.152787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:18.152939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:18.153913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] HCTL ('9', '-', '-', 0) found on session 75 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:18.154054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.158813 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:18.159067 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:18.159276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:18.159403 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:18.160339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] HCTL ('10', '-', '-', 0) found on session 76 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:18.160459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:18.167520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-35b8e57f-1d26-4631-9797-dbde74d47a0b tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "5faa3a7e-8ade-4e0b-9568-465fc7c61dcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.779s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:18.168554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching for a device in session 75 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:18.168762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:18.180163 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching for a device in session 76 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:18.180347 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:18.348983 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:32:18.349354 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:18.349510 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:18.349582 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:18.349833 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:18.419971 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:18.531128 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0037546589999237767 future=<Future at 0x74361828b290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:18.531989 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Emitting event <LifecycleEvent: 1778733123.5271847, 8860392d-b13e-43fe-9f11-b8800d1ba6fa => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:18.532363 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:18.533781 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] VM Stopped (Lifecycle Event)
May 14 04:32:18.533781 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.141585848999966 future=<Future at 0x7435f8566150 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:18.533781 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.1414645320001 future=<Future at 0x7435f8566150 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:18.578822 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:18.579006 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:18.584273 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:32:18.584425 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Claim successful on node np0000000747
May 14 04:32:18.609900 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:18.610095 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:18.990076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:32:19.035863 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 8860392d-b13e-43fe-9f11-b8800d1ba6fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:19.116968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.220498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.220725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.220943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.221107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.221180 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:19.221293 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:19.221388 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.221505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.221637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.221735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.221830 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:19.221987 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received unexpected event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with vm_state active and task_state deleting.
May 14 04:32:19.222084 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.222213 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.222352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.222733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.222908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:19.223104 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received unexpected event network-vif-plugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with vm_state active and task_state deleting.
May 14 04:32:19.223310 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.223661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.223837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.224051 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.224193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:19.224326 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:19.224452 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.224587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Acquiring lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.224756 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.224907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.225035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] No waiting events found dispatching network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:19.225186 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-unplugged-c8645ad6-8a83-4f7b-8466-37d93e660471 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:19.225321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Received event network-vif-deleted-c8645ad6-8a83-4f7b-8466-37d93e660471 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:19.225454 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Neutron deleted interface c8645ad6-8a83-4f7b-8466-37d93e660471; detaching it from the instance and deleting it from the info cache
May 14 04:32:19.225606 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:19.231738 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:19.459118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.459283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.459473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:19.459620 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:19.460040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:19.461765 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Terminating instance
May 14 04:32:19.729009 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-96469af7-d412-401d-aed8-631f322e15f9 req-0a5c755b-8d37-497b-9f7c-eea40e627dfb service nova] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Detach interface failed, port_id=c8645ad6-8a83-4f7b-8466-37d93e660471, reason: Instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:19.734366 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Took 1.38 seconds to deallocate network for instance.
May 14 04:32:19.964992 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:19.993014 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:19.997829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.015199 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Found WWN 330000000f525beb2 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:32:20.015472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:20.015681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000f525beb2', 'path': '/dev/dm-1', 'multipath_id': '330000000f525beb2'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:20.015944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f525beb2', 'path': '/dev/dm-1', 'multipath_id': '330000000f525beb2'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:32:20.020022 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.031922 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.063872 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.161551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:20.161889 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:20.245320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:20.318216 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999702572999922 future=<Future at 0x7436184c3290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:20.321126 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Instance destroyed successfully.
May 14 04:32:20.321513 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lazy-loading 'resources' on Instance uuid 4d665afc-c146-44a9-af0b-e36fcd96568a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:20.348345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:20.348653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:20.527366 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-242034707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:20.527565 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:20.528132 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:20.528770 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lazy-loading 'pci_devices' on Instance uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:20.665979 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:20.823843 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1010121184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serverbootfromvolumestablerescuetest-server-1010121184',id=26,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:29:28Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3030a0d75e9c41828981f529272fd47f',ramdisk_id='',reservation_id='r-c3xn2dv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-589525365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:29:37Z,user_data=None,user_id='3b73f8491edc4c59b345fbd4d3b6c6b0',uuid=4d665afc-c146-44a9-af0b-e36fcd96568a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:20.824337 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converting VIF {"id": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "address": "fa:16:3e:a4:7f:5f", "network": {"id": "b03ed5f1-0387-43f6-a2ae-37f81325d4c1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-693793884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3030a0d75e9c41828981f529272fd47f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f73ecfa-72", "ovs_interfaceid": "7f73ecfa-7252-48cd-bdcd-3f0f3da9776b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:20.824714 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:20.825017 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:20.826006 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.826203 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f73ecfa-72, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:20.827232 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.828044 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:20.828511 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.829329 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.829453 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60ab19f6-2be3-47ab-9e75-196ef564764c) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:20.829988 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.830557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:20.830950 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:20.834186 np0000000747 nova-compute[97971]: INFO os_vif [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=7f73ecfa-7252-48cd-bdcd-3f0f3da9776b,network=Network(b03ed5f1-0387-43f6-a2ae-37f81325d4c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f73ecfa-72')
May 14 04:32:20.834186 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Deleting instance files /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a_del
May 14 04:32:20.834186 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Deletion of /opt/stack/data/nova/instances/4d665afc-c146-44a9-af0b-e36fcd96568a_del complete
May 14 04:32:20.851306 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:32:20.998585 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.031428 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <uuid>78a47990-a6d1-4617-8c1c-538889b9f34a</uuid>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <name>instance-00000029</name>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsV293TestJSON-server-242034707</nova:name>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:16</nova:creationTime>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:user uuid="4e18a4a18a9c458b90e48fa022b5e13c">tempest-ServerActionsV293TestJSON-1284155576-project-member</nova:user>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:project uuid="d8ca6721021640418a98b959a677f8a0">tempest-ServerActionsV293TestJSON-1284155576</nova:project>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         <nova:port uuid="7a85c8c7-f3d6-4104-8047-287669c598a5">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="serial">78a47990-a6d1-4617-8c1c-538889b9f34a</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="uuid">78a47990-a6d1-4617-8c1c-538889b9f34a</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <alias name="ua-46977d6c-2c67-43ce-a101-9ed5481c354a"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <serial>46977d6c-2c67-43ce-a101-9ed5481c354a</serial>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1e:dc:b3"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <target dev="tap7a85c8c7-f3"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/console.log" append="off"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:21.031428 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Preparing to wait for external event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-242034707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:21.034041 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.034483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:21.034483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:21.035748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.035748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '682f5646-128c-5186-a84c-b598bc22febd', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:21.045506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.046280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:21.048172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.048533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a85c8c7-f3, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:21.048682 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a85c8c7-f3, col_values=(('qos', UUID('7f82c779-295d-4165-af85-13ffbcc789c3')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:21.048849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a85c8c7-f3, col_values=(('external_ids', {'iface-id': '7a85c8c7-f3d6-4104-8047-287669c598a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:dc:b3', 'vm-uuid': '78a47990-a6d1-4617-8c1c-538889b9f34a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:21.049582 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.050634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:21.056103 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:21.057255 np0000000747 nova-compute[97971]: INFO os_vif [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3')
May 14 04:32:21.171811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:21.172485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.055s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:21.172686 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:32:21.175568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:21.175759 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.928s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:21.175828 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:32:21.295750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:21.296026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:21.296228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:21.296384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:21.296560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] No waiting events found dispatching network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:21.296743 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:21.296891 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:21.297088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Acquiring lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:21.297265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:21.297707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:21.297864 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] No waiting events found dispatching network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:21.298060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6803fdf-67a3-4874-b10f-cf00ed194dae req-a5e4d616-610d-4987-88e8-56966fe9ac9a service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-unplugged-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:21.342269 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Took 1.38 seconds to destroy the instance on the hypervisor.
May 14 04:32:21.345925 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:21.346208 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:21.346695 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:21.347543 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:21.436427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:21.456811 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:21.683313 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:32:21.683412 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:32:21.686428 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:21.686428 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:21.782243 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c70081f7fcd749669ada222e6be6e8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8b3bba7862432eb957054a0284982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:32:21.920820 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:21.921293 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:22.186348 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:32:22.224960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.225226 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:22.328628 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Successfully created port: f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:32:22.332312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.332815 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.425929 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:22.434682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.434824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:32:22.438711 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000029, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config'
May 14 04:32:22.439735 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '4d665afc-c146-44a9-af0b-e36fcd96568a' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '4d665afc-c146-44a9-af0b-e36fcd96568a' (instance-0000001a)
May 14 04:32:22.441604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.535153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.535803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.584641 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:22.585631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:22.585631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No VIF found with MAC fa:16:3e:1e:dc:b3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:22.585841 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Using config drive
May 14 04:32:22.635055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.636024 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:32:22.641780 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:32:22.643539 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.690521 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:32:22.736768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.737352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.760687 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Took 1.41 seconds to deallocate network for instance.
May 14 04:32:22.874516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.877973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:22.935052 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Successfully updated port: f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:32:22.938678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.766s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:22.942765 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.505s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:22.946366 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:32:22.948900 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Claim successful on node np0000000747
May 14 04:32:22.970313 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:22.970814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:23.012089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:23.012910 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing instance network info cache due to event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:23.013119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] Acquiring lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:23.013240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] Acquired lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:23.013491 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing network info cache for port f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:23.027276 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance 9ab87dcf-3d40-4cfe-812d-bc19d06f3270
May 14 04:32:23.071713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:23.076031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:23.105390 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:23.169154 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:23.170058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:23.275844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:23.279535 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating config drive at /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config
May 14 04:32:23.284145 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoiijocd8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:23.296852 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:23.303418 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:23.305332 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:23.353686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoiijocd8" returned: 0 in 0.069s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:23.359007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:23.362096 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12158MB free_disk=73.09097290039062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:32:23.362302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:23.371656 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-71d7101c-c0fd-43c1-ac84-9faf3bed8230 req-d85b5080-c66e-45d4-b01e-596a5743c648 service nova] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Received event network-vif-deleted-7f73ecfa-7252-48cd-bdcd-3f0f3da9776b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:23.442642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:23.517417 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:23.600473 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:23.710694 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:32:23.710694 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:32:23.710694 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Creating image(s)
May 14 04:32:23.711242 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:23.711555 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:23.712256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:23.712728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:23.713174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:23.797050 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:23.856556 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:23.883892 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.004515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.052657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7340b634-850d-471f-8a0e-d1970f02809f tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "9ab87dcf-3d40-4cfe-812d-bc19d06f3270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.629s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:24.302031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab2b7cee-040e-4b5c-9dcc-b4775e2e7d59 req-65388eb9-8d60-4a96-891e-1b27afff4f68 service nova] Releasing lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:24.303238 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquired lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:24.303238 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:24.320249 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.324183 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.356995 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.375120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:24.375120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:24.375381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:24.375494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:24.375642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:24.380648 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Terminating instance
May 14 04:32:24.676194 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.002044631999979174 future=<Future at 0x7435f8566150 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:24.676821 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-eb89b371-589e-424e-836f-6667af42560b None None] Emitting event <LifecycleEvent: 1778733129.6740239, 5d42ebce-6d76-4893-b335-bceb7181a83a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:24.677070 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:24.677215 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.621854224999879 future=<Future at 0x743618229460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:24.677291 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.6217594979998466 future=<Future at 0x743618229460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:24.677876 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] VM Stopped (Lifecycle Event)
May 14 04:32:24.744066 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:24.744308 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:24.810478 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:24.816706 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:24.816893 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:24.897409 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:24.912006 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:24.939779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.952131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.part --force-share --output=json" returned: 0 in 0.135s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:24.952852 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] 9fdd3734-0958-481c-b580-e5038ff3011e was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:32:24.954177 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:32:24.954568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.part /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:24.973893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:24.980964 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733144.9794128, 78a47990-a6d1-4617-8c1c-538889b9f34a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:24.986740 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Started (Lifecycle Event)
May 14 04:32:25.110266 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.117289 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.161828 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:25.163858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.part /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.converted" returned: 0 in 0.209s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.180834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:25.202316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 5d42ebce-6d76-4893-b335-bceb7181a83a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:25.249345 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:25.282854 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Instance destroyed successfully.
May 14 04:32:25.282854 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'resources' on Instance uuid 52be42da-de7d-4255-a2d2-84bd69a79605 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:25.301218 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.302733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.589s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.303490 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:25.308478 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:25.311043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:25.417647 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:25.429546 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.429681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.430189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.430635 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:25.433879 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:25.434260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:25.510177 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:25.519488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.519835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.520162 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Rebooting instance
May 14 04:32:25.526675 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733145.5262902, 78a47990-a6d1-4617-8c1c-538889b9f34a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:25.526878 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Paused (Lifecycle Event)
May 14 04:32:25.543186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.543846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536,backing_fmt=raw /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:25.570520 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:25.571045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.571379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.571587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.571799 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Processing event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:32:25.572071 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:25.572245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.573176 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:32:25.574079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.574079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.574167 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:25.575204 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received unexpected event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with vm_state building and task_state spawning.
May 14 04:32:25.575592 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:25.575915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.576253 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.576686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.578426 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.579169 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] No waiting events found dispatching network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:25.579835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.580302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:25.580545 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.580792 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:25.581028 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.581229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Acquiring lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.581480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.584905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.585126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] Lock "52be42da-de7d-4255-a2d2-84bd69a79605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.585318 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] No waiting events found dispatching network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:25.585499 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-950c7e44-2508-4043-950e-9bf9ca10efc3 req-af4d1629-9de7-44ff-92a7-85f861b23f58 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-unplugged-a2ffb049-b2a5-4576-9cf1-bc6056029d05 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:25.585922 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:32:25.588194 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Terminating instance
May 14 04:32:25.592141 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance spawned successfully.
May 14 04:32:25.593055 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:32:25.605740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536,backing_fmt=raw /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk 1073741824" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.608670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5911f3cf5cafb8d838c7d6c042c62f9c817bd536" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.608670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:25.692232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5911f3cf5cafb8d838c7d6c042c62f9c817bd536 --force-share --output=json" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:25.693987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:32:25.693987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Ensure instance console log exists: /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:32:25.693987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:25.693987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.693987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.767274 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.826s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:25.767693 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:32:25.772517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.495s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:25.784640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96565693',display_name='tempest-AttachVolumeNegativeTest-server-96565693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-96565693',id=38,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBwCnS4TEOJ5qmgM837AID2NX/mSY4Rim8FvY3X+06hL7JIp0zKerUjC1hVF219b+i0OD49/A+i/0DFreRVrTwKKQMSgOd/3FiLlxRUGJ7WGLQSFnMt2Ralz6gKzTrjUg==',key_name='tempest-keypair-2004684581',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:45Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-z7m6tom0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=52be42da-de7d-4255-a2d2-84bd69a79605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:25.785001 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "address": "fa:16:3e:61:19:25", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ffb049-b2", "ovs_interfaceid": "a2ffb049-b2a5-4576-9cf1-bc6056029d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:25.785903 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:25.786241 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:25.788816 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.789217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2ffb049-b2, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:25.795711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.795711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:25.795711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.796377 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.796672 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51247538-2119-41a8-a30b-2b1a88ba515b) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:25.799592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.799592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:25.799592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:25.801313 np0000000747 nova-compute[97971]: INFO os_vif [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:19:25,bridge_name='br-int',has_traffic_filtering=True,id=a2ffb049-b2a5-4576-9cf1-bc6056029d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ffb049-b2')
May 14 04:32:25.801611 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Deleting instance files /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605_del
May 14 04:32:25.802432 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Deletion of /opt/stack/data/nova/instances/52be42da-de7d-4255-a2d2-84bd69a79605_del complete
May 14 04:32:25.921839 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Releasing lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:25.922473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance network_info: |[{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:32:25.925308 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Start _get_guest_xml network_info=[{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='cd6e473c7e272e2cab59120c86cdb6e9',container_format='bare',created_at=2026-05-14T04:32:07Z,direct_url=<?>,disk_format='qcow2',id=9fdd3734-0958-481c-b580-e5038ff3011e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1999461395',owner='cf8b3bba7862432eb957054a0284982b',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-14T04:32:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '9fdd3734-0958-481c-b580-e5038ff3011e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:25.927219 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:25.928866 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1356233134', uuid='3b3f3c21-1103-4b9c-8a06-9ab0d95826e8'), owner=OwnerMeta(userid='c70081f7fcd749669ada222e6be6e8a1', username='tempest-TestStampPattern-1110078540-project-member', projectid='cf8b3bba7862432eb957054a0284982b', projectname='tempest-TestStampPattern-1110078540'), image=ImageMeta(id='9fdd3734-0958-481c-b580-e5038ff3011e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'cf8b3bba7862432eb957054a0284982b'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733145.9283884) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:25.930279 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:25.930723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:25.931721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:25.931913 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:25.933062 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:25.933428 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cd6e473c7e272e2cab59120c86cdb6e9',container_format='bare',created_at=2026-05-14T04:32:07Z,direct_url=<?>,disk_format='qcow2',id=9fdd3734-0958-481c-b580-e5038ff3011e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1999461395',owner='cf8b3bba7862432eb957054a0284982b',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-14T04:32:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:25.933586 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:25.934178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:25.934178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:25.934178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:25.934178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:25.934375 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:25.934375 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:25.934541 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:25.934861 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:25.935040 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:25.951777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1356233134',display_name='tempest-TestStampPattern-server-1356233134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1356233134',id=42,image_ref='9fdd3734-0958-481c-b580-e5038ff3011e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-pcmsqe4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5c037683-9726-4c1e-b4eb-d41e0155d9fa',image_min_disk='1',image_min_ram='0',image_owner_id='cf8b3bba7862432eb957054a0284982b',image_owner_project_name='tempest-TestStampPattern-1110078540',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1110078540-project-member',image_user_id='c70081f7fcd749669ada222e6be6e8a1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:23Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=3b3f3c21-1103-4b9c-8a06-9ab0d95826e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:25.952219 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:25.952637 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:25.953354 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:26.000737 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.031302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:26.035582 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999765390999983 future=<Future at 0x74361824a8d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:26.035582 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733146.0332613, 78a47990-a6d1-4617-8c1c-538889b9f34a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:26.035582 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Resumed (Lifecycle Event)
May 14 04:32:26.084809 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:26.084993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:26.085095 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:26.093064 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:26.101724 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.102716 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.106639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.106639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.109191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.110079 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:26.117269 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.142142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.147411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.175400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.281470 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:32:26.281676 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:32:26.282030 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:26.282433 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:26.299539 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00042784300012499443 future=<Future at 0x743618229460 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:26.299679 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:26.299731 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.023103654999886 future=<Future at 0x7435f8475040 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:26.299810 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.023028944000089 future=<Future at 0x7435f8475040 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:26.302489 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] Emitting event <LifecycleEvent: 1778733131.2989872, 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:26.302671 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] VM Stopped (Lifecycle Event)
May 14 04:32:26.315579 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:26.315579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:26.317831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:26.318182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:26.319706 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] No waiting events found dispatching network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:26.319706 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ce4e935c-7df6-4948-b07d-cea04dd3b743 req-34574471-8375-49a4-95d3-b43e6da64f00 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:26.320363 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Took 1.42 seconds to destroy the instance on the hypervisor.
May 14 04:32:26.321587 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:26.321906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:26.322208 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:26.322208 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:26.423003 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:32:26.426253 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:26.426253 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:26.457241 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <uuid>3b3f3c21-1103-4b9c-8a06-9ab0d95826e8</uuid>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <name>instance-0000002a</name>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestStampPattern-server-1356233134</nova:name>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:25</nova:creationTime>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:property name="img_owner_id">cf8b3bba7862432eb957054a0284982b</nova:property>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:user uuid="c70081f7fcd749669ada222e6be6e8a1">tempest-TestStampPattern-1110078540-project-member</nova:user>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:project uuid="cf8b3bba7862432eb957054a0284982b">tempest-TestStampPattern-1110078540</nova:project>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         <nova:port uuid="f18f39e9-7273-4df6-8a76-5ed50786263c">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="serial">3b3f3c21-1103-4b9c-8a06-9ab0d95826e8</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="uuid">3b3f3c21-1103-4b9c-8a06-9ab0d95826e8</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.config"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:05:eb:af"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <target dev="tapf18f39e9-72"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/console.log" append="off"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:26.457241 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:26.462492 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Preparing to wait for external event network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:32:26.462492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:26.462492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:26.462492 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:26.463212 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1356233134',display_name='tempest-TestStampPattern-server-1356233134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1356233134',id=42,image_ref='9fdd3734-0958-481c-b580-e5038ff3011e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-pcmsqe4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5c037683-9726-4c1e-b4eb-d41e0155d9fa',image_min_disk='1',image_min_ram='0',image_owner_id='cf8b3bba7862432eb957054a0284982b',image_owner_project_name='tempest-TestStampPattern-1110078540',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1110078540-project-member',image_user_id='c70081f7fcd749669ada222e6be6e8a1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:23Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=3b3f3c21-1103-4b9c-8a06-9ab0d95826e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:26.463712 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:26.464558 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:26.465201 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:26.466829 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Instance destroyed successfully.
May 14 04:32:26.467276 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.468754 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.469280 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lazy-loading 'resources' on Instance uuid 7000f23a-3a6a-40b1-8346-74d4b436e56a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:26.470376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:26.472441 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.473724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e608703-f1d2-57c1-8b26-28cc4a36d572', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.475639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.475639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:26.483303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.490690 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:26.493899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.494364 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf18f39e9-72, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.494846 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf18f39e9-72, col_values=(('qos', UUID('bee94edf-49a3-43e7-8fe3-891f6d5a32a4')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.495071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf18f39e9-72, col_values=(('external_ids', {'iface-id': 'f18f39e9-7273-4df6-8a76-5ed50786263c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:eb:af', 'vm-uuid': '3b3f3c21-1103-4b9c-8a06-9ab0d95826e8'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.501753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.502557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:26.514100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.518471 np0000000747 nova-compute[97971]: INFO os_vif [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72')
May 14 04:32:26.539079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:26.544045 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:26.588192 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:26.618722 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Took 10.94 seconds to spawn the instance on the hypervisor.
May 14 04:32:26.620837 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:26.787835 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:32:26.805935 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6698dcbb-1869-45af-8a3d-b11d0ea1e2c0 tempest-VolumesNegativeTest-66206547 tempest-VolumesNegativeTest-66206547-project-member] [instance: 5faa3a7e-8ade-4e0b-9568-465fc7c61dcc] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:26.929389 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:26.975095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:26:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-866503317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumemultiattachtest-server-866503317',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:26:48Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b93f0893fbf443a9853f0a36fc84ff4c',ramdisk_id='',reservation_id='r-7gck1zu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-AttachVolumeMultiAttachTest-1725820811',owner_user_name='tempest-AttachVolumeMultiAttachTest-1725820811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:26:48Z,user_data=None,user_id='c46830061c284ed38642cf66db196b0d',uuid=7000f23a-3a6a-40b1-8346-74d4b436e56a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:26.975355 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converting VIF {"id": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "address": "fa:16:3e:ac:2f:49", "network": {"id": "38ece52f-989d-41f1-9512-f4e8502e6474", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1466052760-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b93f0893fbf443a9853f0a36fc84ff4c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d32e0e9-b6", "ovs_interfaceid": "4d32e0e9-b676-4d88-83ac-8db2cc16a609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:26.976005 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:26.976300 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:26.979763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.979763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d32e0e9-b6, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.981113 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.981113 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:26.989158 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.989795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.990636 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=919a559b-77b7-4985-ac99-63ee174a1d2b) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:26.991040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:26.992283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:26.998934 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:27.004647 np0000000747 nova-compute[97971]: INFO os_vif [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:2f:49,bridge_name='br-int',has_traffic_filtering=True,id=4d32e0e9-b676-4d88-83ac-8db2cc16a609,network=Network(38ece52f-989d-41f1-9512-f4e8502e6474),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d32e0e9-b6')
May 14 04:32:27.050702 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Successfully created port: 4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:32:27.059892 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:27.059892 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:27.060533 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:27.065340 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:27.065797 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:32:27.066165 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99980790099994 future=<Future at 0x7435f8474c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:27.067919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:27.067919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:27.067919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:27.098479 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsi session list stdout=tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7 (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:27.098821 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:27.098821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:27.099082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '20')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:27.099864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7', '21')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:27.100669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74362d9b0860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:27.101250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:27.101464 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Flush multipath device 330000000f221aac0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:27.143706 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Took 20.58 seconds to build instance.
May 14 04:32:27.152860 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:27.204652 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:27.243903 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:27.257938 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:27.258294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:27.259307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:27.270857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:27.271054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:27.284308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.290913 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:32:27.313571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.40.100,3260]
May 14 04:32:27.313571 np0000000747 nova-compute[97971]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.40.100,3260] successful.
May 14 04:32:27.313571 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.331467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.345769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.383142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.50.100,3260]
May 14 04:32:27.383142 np0000000747 nova-compute[97971]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-7f6aa122-73a4-4c06-9a6f-580b8117a0a7, portal: 192.168.50.100,3260] successful.
May 14 04:32:27.383142 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.398628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:27.398902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:27.399091 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] <== disconnect_volume: return (339ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:27.399229 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:27.399510 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Deleting instance files /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a_del
May 14 04:32:27.400094 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Deletion of /opt/stack/data/nova/instances/7000f23a-3a6a-40b1-8346-74d4b436e56a_del complete
May 14 04:32:27.436280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.666s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:27.438507 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 4.074s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:27.504530 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Deleted allocations for instance 4d665afc-c146-44a9-af0b-e36fcd96568a
May 14 04:32:27.545732 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Successfully updated port: 4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:32:27.577684 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:27.607329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-changed-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:27.607329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Refreshing instance network info cache due to event network-changed-4815f088-fcfc-47d4-9242-1dfd0664c117. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:27.607329 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] Acquiring lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:27.607329 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] Acquired lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:27.607329 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Refreshing network info cache for port 4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:27.646708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e72a4e6-88da-497c-937e-95b699e2796a tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.091s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:27.748691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:27.797634 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Booting with volume dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 at /dev/vda
May 14 04:32:27.839105 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:27.855165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:32:27.882651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:27.913467 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Took 1.82 seconds to destroy the instance on the hypervisor.
May 14 04:32:27.914890 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:27.915294 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:27.915481 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:27.916221 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:27.930953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:32:27.931812 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:32:27.944210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:32:27.944210 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe91:9180', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627'] 
May 14 04:32:27.944785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:32:27.951053 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:32:27.957402 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:27.961643 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Updating existing volume attachment record: e0d2cdda-6d43-4b60-bb9c-a5462c3cb7e0 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:32:28.048523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:28.057956 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:28.057956 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:28.058150 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No VIF found with MAC fa:16:3e:05:eb:af, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:28.060433 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Using config drive
May 14 04:32:28.063828 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:28.080481 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Took 1.76 seconds to deallocate network for instance.
May 14 04:32:28.109849 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:28.217819 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:28.255600 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:28.385900 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:28.386136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] Acquiring lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:28.386311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:28.386429 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:28.386549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] No waiting events found dispatching network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:28.386672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-unplugged-4d32e0e9-b676-4d88-83ac-8db2cc16a609 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:28.386768 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Received event network-vif-deleted-a2ffb049-b2a5-4576-9cf1-bc6056029d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:28.386963 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Received event network-vif-deleted-4d32e0e9-b676-4d88-83ac-8db2cc16a609 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:28.386963 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Neutron deleted interface 4d32e0e9-b676-4d88-83ac-8db2cc16a609; detaching it from the instance and deleting it from the info cache
May 14 04:32:28.387067 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:28.411126 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:28.525338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e07b9df-2a57-410c-8f3d-b3d1aae5f68c tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Lock "4d665afc-c146-44a9-af0b-e36fcd96568a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.065s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:28.571257 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:28.591517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:28.637867 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-changed-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:28.641150 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Refreshing instance network info cache due to event network-changed-7a85c8c7-f3d6-4104-8047-287669c598a5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:28.641150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] Acquiring lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:28.641150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] Acquired lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:28.641150 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Refreshing network info cache for port 7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:28.656414 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.656688 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 8535c256-4cff-4edb-9e78-23028fb7a32d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.656830 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.656903 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 52be42da-de7d-4255-a2d2-84bd69a79605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.657033 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance dabbc5d1-d4bf-4184-8764-67d80388605d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.657118 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.657202 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 78a47990-a6d1-4617-8c1c-538889b9f34a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.657961 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.658110 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 6d19d8f1-482c-495b-bc58-1954cd6be10e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:32:28.658259 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:32:28.658397 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:32:23 up 32 min,  2 users,  load average: 10.09, 8.25, 4.46\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_deleting': '2', 'num_os_type_None': '9', 'num_proj_b93f0893fbf443a9853f0a36fc84ff4c': '1', 'io_workload': '2', 'num_task_None': '4', 'num_proj_9e1481ce79a54b72a2f83aa185ea46d1': '2', 'num_proj_cf8b3bba7862432eb957054a0284982b': '2', 'num_task_rebooting_hard': '1', 'num_proj_6495e941aabb4280afd6c384a250e6dd': '1', 'num_proj_ffc8341628a343b88c90dd7e5d8e5427': '1', 'num_proj_d8ca6721021640418a98b959a677f8a0': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_task_block_device_mapping': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:32:28.744664 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Creating config drive at /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.config
May 14 04:32:28.747656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp21nw3wl {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:28.805661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp21nw3wl" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:28.816394 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:28.892752 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b172d5-f955-4ea8-9225-5932d92632c2 req-74df64a3-d52f-44bc-950a-5b584ded6d33 service nova] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Detach interface failed, port_id=4d32e0e9-b676-4d88-83ac-8db2cc16a609, reason: Instance 7000f23a-3a6a-40b1-8346-74d4b436e56a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:28.916567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b607c723-9135-4014-83fb-c548d85f52ad req-1c323c39-7bfb-446b-b724-26a35d3a344f service nova] Releasing lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:28.921261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:28.921261 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:29.142340 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:29.303571 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:29.303571 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:29.303571 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.318593 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Took 1.40 seconds to deallocate network for instance.
May 14 04:32:29.326049 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.329840 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.338280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.364515 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.447482 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.468153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.473444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.497487 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.529716 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.530644 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.545397 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:29.643847 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:29.649686 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.659517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:29.691761 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999530972000002 future=<Future at 0x7435f83271d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:29.695490 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance destroyed successfully.
May 14 04:32:29.697238 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'resources' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:29.759818 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54a94791-0a52-4d3c-a890-a4473def9658 req-0de7bea1-ac6b-4e7c-a1d1-d1c0f0cd3c1b service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:29.763053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54a94791-0a52-4d3c-a890-a4473def9658 req-0de7bea1-ac6b-4e7c-a1d1-d1c0f0cd3c1b service nova] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:29.767594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54a94791-0a52-4d3c-a890-a4473def9658 req-0de7bea1-ac6b-4e7c-a1d1-d1c0f0cd3c1b service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:29.767594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-54a94791-0a52-4d3c-a890-a4473def9658 req-0de7bea1-ac6b-4e7c-a1d1-d1c0f0cd3c1b service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:29.767594 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-54a94791-0a52-4d3c-a890-a4473def9658 req-0de7bea1-ac6b-4e7c-a1d1-d1c0f0cd3c1b service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Processing event network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:32:29.805085 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:29.808920 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:29.896549 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Took 0.58 seconds to detach 1 volumes for instance.
May 14 04:32:29.904978 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updated VIF entry in instance network info cache for port 7a85c8c7-f3d6-4104-8047-287669c598a5. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:32:29.905307 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating instance_info_cache with network_info: [{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:29.982921 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Updating instance_info_cache with network_info: [{"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:30.111950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:32:30.113217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:32:30.113463 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Creating image(s)
May 14 04:32:30.113755 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:32:30.113900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Ensure instance console log exists: /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:32:30.114170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:30.114360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:30.114506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:30.200517 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:28Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:30.200750 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:30.201400 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:30.201661 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:30.205690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.205690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a7c243-fa, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:30.205690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.206748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:30.207947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.208723 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.209040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d4d359d-cd3a-46c3-a01b-2ecacc92e621) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:30.210076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.210790 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:30.211745 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:30.214698 np0000000747 nova-compute[97971]: INFO os_vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa')
May 14 04:32:30.216880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:30.217287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:30.218649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:30.218649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:30.218649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:30.218649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:30.243692 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:30.243905 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:30.244066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:30.244233 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '74')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:30.245196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '73')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:30.246356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618383b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:30.246607 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:30.247190 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flush multipath device 3300000009ef5ae9c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:30.256068 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:32:30.256774 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733150.2565272, 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:30.257199 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] VM Started (Lifecycle Event)
May 14 04:32:30.266363 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:32:30.271861 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance spawned successfully.
May 14 04:32:30.272236 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:32:30.274971 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:30.275510 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:30.282640 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:30.319479 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:32:30.320182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.883s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:30.320182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.729s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:30.320510 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:30.329348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:30.377693 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Refreshing inventories for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 04:32:30.383191 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:30.383354 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:30.384400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:30.396653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:30.396865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:30.409291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.410284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4362272f-ce98-4317-aed6-25afb4b012fe req-01f2d32b-ef51-46c9-89bc-576c79988fec service nova] Releasing lock "refresh_cache-78a47990-a6d1-4617-8c1c-538889b9f34a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:30.415442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:30.422972 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Updating ProviderTree inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 04:32:30.423251 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:32:30.443521 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260]
May 14 04:32:30.443521 np0000000747 nova-compute[97971]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260] successful.
May 14 04:32:30.443521 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.461369 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.477373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.485008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-6d19d8f1-482c-495b-bc58-1954cd6be10e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:30.485325 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance network_info: |[{"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:32:30.486203 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Start _get_guest_xml network_info=[{"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e0d2cdda-6d43-4b60-bb9c-a5462c3cb7e0', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6d19d8f1-482c-495b-bc58-1954cd6be10e', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'serial': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:30.488766 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:30.489809 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1827660507', uuid='6d19d8f1-482c-495b-bc58-1954cd6be10e'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733150.4894323) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:30.493038 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Refreshing aggregate associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, aggregates: None {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 04:32:30.495927 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:30.496398 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:30.498136 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:30.498441 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:30.499763 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:30.500153 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:30.500337 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:30.500478 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:30.500658 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:30.500792 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:30.500911 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:30.501131 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:30.501276 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:30.501418 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:30.501553 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:30.501846 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:30.516658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260]
May 14 04:32:30.516658 np0000000747 nova-compute[97971]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260] successful.
May 14 04:32:30.516658 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.520917 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:32:30.522268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:30.522530 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:30.539514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.539753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:30.539833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== disconnect_volume: return (322ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:30.539924 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:30.540680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.018s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:30.541395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:32:30.549106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start _get_guest_xml network_info=[{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ec2043d3-3da6-418e-aacb-e796c7c4ff10,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': 'ec2043d3-3da6-418e-aacb-e796c7c4ff10'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b64e0fb2-c0fe-4d1d-87d6-dda56ee06393', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': 'dabbc5d1-d4bf-4184-8764-67d80388605d', 'attached_at': '', 'detached_at': '', 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'serial': '703750fc-3974-4b36-a16d-1d5b8ab367f7'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:30.553064 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:30.554627 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ec2043d3-3da6-418e-aacb-e796c7c4ff10', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1098880331', uuid='dabbc5d1-d4bf-4184-8764-67d80388605d'), owner=OwnerMeta(userid='5673930adce14c6ea2b647e1a339636b', username='tempest-TestMinimumBasicScenario-482942579-project-member', projectid='6495e941aabb4280afd6c384a250e6dd', projectname='tempest-TestMinimumBasicScenario-482942579'), image=ImageMeta(id='ec2043d3-3da6-418e-aacb-e796c7c4ff10', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733150.554192) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:30.556125 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:30.557121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:30.559503 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Refreshing trait associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, traits: COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_SOUND_MODEL_PCSPK,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 04:32:30.562633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:30.563813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:30.564098 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:30.567054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:30.567492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:30.567794 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:30.568059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:30.569301 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:30.569465 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:30.573900 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ec2043d3-3da6-418e-aacb-e796c7c4ff10,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:30.574181 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:30.574337 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:30.574522 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:30.574669 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:30.574797 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:30.575028 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:30.575154 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:30.575306 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:30.575451 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:30.575603 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:30.575813 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'vcpu_model' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:30.580562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:30.580562 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.587434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:30.587434 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4] added
May 14 04:32:30.599956 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:30.599956 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:30.599956 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:30.600360 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:30.606186 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4] added
May 14 04:32:30.606186 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:30.606186 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:30.606186 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:30.606186 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:30.606186 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:30.606186 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:30.606450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:30.606744 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:30.606946 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:30.702944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:30.702944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:30.702944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:30.702944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:30.702944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:30.703491 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state active and task_state reboot_started_hard.
May 14 04:32:30.704876 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:30.705263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:30.705562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:30.706077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:30.706585 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:30.707028 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6d39878c-eabf-4ed8-af2e-8caf8ad6504e req-8805a8ba-634e-47d3-8f45-e5f117770502 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state active and task_state reboot_started_hard.
May 14 04:32:30.763056 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:30.767558 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:30.781305 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Took 7.07 seconds to spawn the instance on the hypervisor.
May 14 04:32:30.781682 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:30.822456 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:31.001987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:31.080937 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Object Instance<dabbc5d1-d4bf-4184-8764-67d80388605d> lazy-loaded attributes: resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:32:31.096969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:31.097775 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:31.097978 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:31.206689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:31.206689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:31.206689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:31.207014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:31.208279 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:32:31.208279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:31.208279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:31.272533 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:32:31.275190 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733151.2748475, 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:31.275337 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] VM Paused (Lifecycle Event)
May 14 04:32:31.290476 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:31.296774 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Took 12.79 seconds to build instance.
May 14 04:32:31.600646 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:31.610420 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:31.616657 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:31.616657 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.624004 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:31.632936 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:31.632936 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.646689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.647431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.661682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.661682 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.661682 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.661682 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.661682 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:31.661949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.661949 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.661949 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.661949 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.661949 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.669809 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:31.700911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.50.100,3260]
May 14 04:32:31.700911 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.50.100,3260] successful.
May 14 04:32:31.700911 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.715531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.733738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.40.100,3260]
May 14 04:32:31.733738 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.40.100,3260] successful.
May 14 04:32:31.733738 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.740766 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:31.740766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('11', '-', '-', 0) found on session 77 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:31.741719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:31.746171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:31.759512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 77 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:31.759512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:31.770861 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:31.770861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:31.771723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('12', '-', '-', 0) found on session 78 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:31.771868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:31.778935 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:31.783126 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733151.7828603, 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:31.783278 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] VM Resumed (Lifecycle Event)
May 14 04:32:31.800039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7da932b5-38f5-4a4e-b8f1-efdfe939a324 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.300s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:31.801727 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 78 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:31.801914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:31.814112 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:31.814445 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:31.814726 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:31.815067 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:31.815123 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:32:31.815535 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 14.25 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:31.850204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:31.850540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:31.850788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:31.850957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:31.851406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] No waiting events found dispatching network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:31.851872 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ccefbfca-dd97-4572-9996-6f7d50ed71fb req-df2c6789-e87d-4b51-a193-c3d2fe1007d4 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received unexpected event network-vif-plugged-f18f39e9-7273-4df6-8a76-5ed50786263c for instance with vm_state active and task_state None.
May 14 04:32:32.157182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.837s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:32.159554 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.748s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:32.220866 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Deleted allocations for instance 52be42da-de7d-4255-a2d2-84bd69a79605
May 14 04:32:32.286041 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:32.288331 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:32.323387 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004869560000315687 future=<Future at 0x7435f8475040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:32.325374 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Emitting event <LifecycleEvent: 1778733137.3227713, 9ab87dcf-3d40-4cfe-812d-bc19d06f3270 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:32.325374 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:32.325374 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] VM Stopped (Lifecycle Event)
May 14 04:32:32.326724 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.991706018000059 future=<Future at 0x7436184c3290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:32.326724 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.9914903549999963 future=<Future at 0x7436184c3290 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:32.569707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:32:32.707271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:32.707522 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:32.829017 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: 9ab87dcf-3d40-4cfe-812d-bc19d06f3270] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:33.210680 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:33.233420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3778abca-6ccc-4d5d-abf4-9639b8eb61c6 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "52be42da-de7d-4255-a2d2-84bd69a79605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.859s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:33.593945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 33000000094bf080b for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:32:33.594289 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:33.594868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.387s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:33.595208 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:32:33.598208 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3072ms) {'type': 'block', 'scsi_wwn': '33000000094bf080b', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000094bf080b'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:33.598208 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094bf080b', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000094bf080b'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:32:33.612114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:33.612797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:33.613300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:33.613475 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:33.613863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:33.614254 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:33.625856 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:33.625856 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:33.637993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:33.637993 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:33.638700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7] added
May 14 04:32:33.638700 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:33.638700 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:33.638700 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:33.638700 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:33.638700 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:33.638700 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:33.638859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:33.639175 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:33.639344 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:33.641636 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '6d19d8f1-482c-495b-bc58-1954cd6be10e', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'serial': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:32:33.649658 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:32:33.649943 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:32:33.652590 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:32:33.659415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7] added
May 14 04:32:33.659415 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:33.659415 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:33.659415 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:33.659415 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:33.659415 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:33.659415 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:33.659713 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:33.659870 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0459(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:33.660029 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:33.675637 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.luks [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 04:32:33.676265 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:32:33.676461 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:32:33.676682 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:32:33.677286 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7435f84b1220>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '6d19d8f1-482c-495b-bc58-1954cd6be10e', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'serial': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:32:33.677448 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] formatting encrypted volume /dev/dm-2 {{(pid=97971) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 04:32:33.721884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.562s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:33.813762 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Deleted allocations for instance 7000f23a-3a6a-40b1-8346-74d4b436e56a
May 14 04:32:33.934989 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:33.935400 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing instance network info cache due to event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:33.935441 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] Acquiring lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:33.935577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] Acquired lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:33.935763 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing network info cache for port f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:34.134505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:34.134863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:34.443509 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:34.549595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:34.639510 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:34.642137 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:34.658678 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:34.658678 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.663698 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:34.676983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:34.680288 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:34.680288 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.696285 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.696649 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:34.706438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.730452 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.731510 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:34.748266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260]
May 14 04:32:34.748266 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260] successful.
May 14 04:32:34.748266 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.762429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.778261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260]
May 14 04:32:34.778261 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260] successful.
May 14 04:32:34.778261 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.785823 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.786210 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:34.786503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:34.786586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:34.787981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('13', '-', '-', 0) found on session 79 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:34.788135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:34.793954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:34.807381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 79 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:34.807532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.826240 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:34.826899 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fef1cc3-a9a0-4863-92b4-d33e05f21b79 tempest-AttachVolumeMultiAttachTest-1725820811 tempest-AttachVolumeMultiAttachTest-1725820811-project-member] Lock "7000f23a-3a6a-40b1-8346-74d4b436e56a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.248s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:34.828827 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:34.830541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:34.830541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:34.830541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('14', '-', '-', 0) found on session 80 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:34.830541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:34.839325 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:34.853565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 80 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:34.854044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:34.858207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:34.858207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:35.034646 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updated VIF entry in instance network info cache for port f18f39e9-7273-4df6-8a76-5ed50786263c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:32:35.035073 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:35.145858 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Ignoring supplied device name: /dev/vdb
May 14 04:32:35.212798 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:35.318327 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00042684000004555855 future=<Future at 0x7436184c3290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:35.318500 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:35.318659 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.714335274000177 future=<Future at 0x74361824a8d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:35.318785 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.714186615000017 future=<Future at 0x74361824a8d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:35.320699 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Emitting event <LifecycleEvent: 1778733140.317791, 4d665afc-c146-44a9-af0b-e36fcd96568a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:35.321007 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] VM Stopped (Lifecycle Event)
May 14 04:32:35.363661 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Detaching volume c1b3e152-aa66-4b3b-be4d-e735070fbe5c
May 14 04:32:35.435877 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Attempting to driver detach volume c1b3e152-aa66-4b3b-be4d-e735070fbe5c from mountpoint /dev/vdb
May 14 04:32:35.446992 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:32:35.449140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:32:35.449348 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Attempting to detach device vdb from instance 8535c256-4cff-4edb-9e78-23028fb7a32d from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:32:35.449786 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <alias name="ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c"/>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <serial>c1b3e152-aa66-4b3b-be4d-e735070fbe5c</serial>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]: </disk>
May 14 04:32:35.449786 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:32:35.467096 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance 8535c256-4cff-4edb-9e78-23028fb7a32d from the persistent domain config.
May 14 04:32:35.467096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] (1/8): Attempting to detach device vdb with device alias ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c from instance 8535c256-4cff-4edb-9e78-23028fb7a32d from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:32:35.467096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <alias name="ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c"/>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <serial>c1b3e152-aa66-4b3b-be4d-e735070fbe5c</serial>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]: </disk>
May 14 04:32:35.467096 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:32:35.537733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb18ce6f-f0a8-4eeb-a3cc-47adda070538 req-93cc04ac-4a02-4d2f-9ffe-7c76f8da0556 service nova] Releasing lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:35.580518 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:35.613916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:32:35.650686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:35.828478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 4d665afc-c146-44a9-af0b-e36fcd96568a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:36.064818 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:36.067880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:36.068425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733156.0678954, 8535c256-4cff-4edb-9e78-23028fb7a32d => ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:32:36.072510 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c1b3e152-aa66-4b3b-be4d-e735070fbe5c for instance 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:32:36.076983 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance 8535c256-4cff-4edb-9e78-23028fb7a32d from the live domain config.
May 14 04:32:36.080944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:36.081274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:36.081561 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:36.635639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found WWN 3300000009ef5ae9c for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:32:36.636723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:36.636723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== connect_volume: return (5428ms) {'type': 'block', 'scsi_wwn': '3300000009ef5ae9c', 'path': '/dev/dm-3', 'multipath_id': '3300000009ef5ae9c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:36.636723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009ef5ae9c', 'path': '/dev/dm-3', 'multipath_id': '3300000009ef5ae9c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:32:36.637488 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.556s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:36.637940 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:36.638095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:36.685877 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:36.686229 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:36.686229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:36.686685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '67')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:36.687311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c', '68')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:36.688182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84944a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:36.688382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:36.688639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flush multipath device 3300000008d3c822d {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:36.727152 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:36.749227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:36.751897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:36.751897 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Attaching volume b6fe62fc-bde4-492d-9769-13e0ea883ca3 to /dev/vdb
May 14 04:32:36.781561 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:36.817104 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:36.825097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:36.825313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:36.827717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:36.837271 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:32:36.846332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:36.846332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:36.861050 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:36.875141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:36.905294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.40.100,3260]
May 14 04:32:36.905294 np0000000747 nova-compute[97971]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.40.100,3260] successful.
May 14 04:32:36.905294 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:36.925577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:32:36.925887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:32:36.932624 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:36.941913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:32:36.943931 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe06:14f3', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe91:9180', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627', 'fe80::fc16:3eff:fe05:ebaf'] 
May 14 04:32:36.944150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:32:36.944410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:32:36.944768 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:36.945114 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating existing volume attachment record: e7f4167b-4c11-4542-af90-7a34279ebc28 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:32:36.949870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.002320 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.50.100,3260]
May 14 04:32:37.002320 np0000000747 nova-compute[97971]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-c1b3e152-aa66-4b3b-be4d-e735070fbe5c, portal: 192.168.50.100,3260] successful.
May 14 04:32:37.002320 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.025026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.025917 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:37.026016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== disconnect_volume: return (944ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:37.026539 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:37.149995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:28Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:37.150286 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:37.150971 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:37.152163 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'pci_devices' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:37.537138 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:32:37.537772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:37.538002 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:37.538681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:37.538940 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:32:37.556115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:37.557024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:37.557715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:37.558098 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:37.558669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:37.558928 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:37.578707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:37.578707 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.585368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:32:37.585368 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.599210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3] added
May 14 04:32:37.599210 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:37.599210 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:37.599210 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:37.599210 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:37.599210 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:37.599210 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.599776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:37.599776 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0416(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:37.599776 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:37.603408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3] added
May 14 04:32:37.603408 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:32:37.603408 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:37.603408 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:37.603408 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:32:37.603408 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:32:37.603408 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:37.604340 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:32:37.604340 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:32:37.604340 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:32:37.632342 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:37.658802 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Object Instance<dabbc5d1-d4bf-4184-8764-67d80388605d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:32:37.660337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <uuid>dabbc5d1-d4bf-4184-8764-67d80388605d</uuid>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <name>instance-00000027</name>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestMinimumBasicScenario-server-1098880331</nova:name>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:30</nova:creationTime>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:image uuid="ec2043d3-3da6-418e-aacb-e796c7c4ff10">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:user uuid="5673930adce14c6ea2b647e1a339636b">tempest-TestMinimumBasicScenario-482942579-project-member</nova:user>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:project uuid="6495e941aabb4280afd6c384a250e6dd">tempest-TestMinimumBasicScenario-482942579</nova:project>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="ec2043d3-3da6-418e-aacb-e796c7c4ff10"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         <nova:port uuid="05a7c243-fa8c-42a6-a886-aee31b18a80e">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="serial">dabbc5d1-d4bf-4184-8764-67d80388605d</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="uuid">dabbc5d1-d4bf-4184-8764-67d80388605d</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk.config"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <alias name="ua-703750fc-3974-4b36-a16d-1d5b8ab367f7"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-3"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <serial>703750fc-3974-4b36-a16d-1d5b8ab367f7</serial>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:dd:c4:26"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <target dev="tap05a7c243-fa"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/console.log" append="off"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:37.660337 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:37.663716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:37.785768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:37.785768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:37.900005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:37.900605 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:32:37.902120 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'trusted_certs' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:38.404720 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Object Instance<dabbc5d1-d4bf-4184-8764-67d80388605d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:32:38.405324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:38.543650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9d2ae20973a915ccb01b517ed7c165ec6a7952b --force-share --output=json" returned: 0 in 0.137s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:38.544214 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:32:38.544685 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:38.601781 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:32:38.608391 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:32:38.612975 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:38.624399 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:38.624399 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:32:38.635582 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:32:38.635582 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.649563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6a729451-0206-4edd-ab06-9d5ae73c7229 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.792s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:38.655195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.657887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.676624 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:38.678340 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Cannot resize image /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:32:38.678340 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'migration_context' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.681437 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.681641 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.688952 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.689188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:38.727211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.40.100,3260]
May 14 04:32:38.727211 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.40.100,3260] successful.
May 14 04:32:38.727211 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.734574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.50.100,3260]
May 14 04:32:38.734574 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.50.100,3260] successful.
May 14 04:32:38.734574 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.745286 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.752128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.767803 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.768109 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:38.768537 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:38.768714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:38.770579 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] HCTL ('7', '-', '-', 0) found on session 81 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:38.770579 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:38.773606 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:38.777000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:38.777000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:32:38.777000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] HCTL ('8', '-', '-', 0) found on session 82 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:32:38.777000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:32:38.807965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 82 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:38.807965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:38.822574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 81 and hctl ['7', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:38.847194 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:38.904067 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:32:38.904067 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:32:38.904067 np0000000747 nova-compute[97971]:     <volume>dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4</volume>
May 14 04:32:38.904067 np0000000747 nova-compute[97971]:   </usage>
May 14 04:32:38.904067 np0000000747 nova-compute[97971]: </secret>
May 14 04:32:38.904067 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:32:39.180779 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Object Instance<dabbc5d1-d4bf-4184-8764-67d80388605d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:32:39.181799 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:28Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:39.182043 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:39.182637 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:39.182903 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:39.183460 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.183816 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.184163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:39.185218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.185427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48f9390e-bda4-5468-b83e-efcba7d161e7', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.186365 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.190356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:39.192817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.192999 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05a7c243-fa, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.193367 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05a7c243-fa, col_values=(('qos', UUID('ff14d2ac-e947-4e07-b045-854d97989a34')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.193562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05a7c243-fa, col_values=(('external_ids', {'iface-id': '05a7c243-fa8c-42a6-a886-aee31b18a80e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c4:26', 'vm-uuid': 'dabbc5d1-d4bf-4184-8764-67d80388605d'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.194922 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.196423 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:39.201932 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.206136 np0000000747 nova-compute[97971]: INFO os_vif [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa')
May 14 04:32:39.362931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:39.363191 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:39.364430 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:39.368005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:39.368220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:39.370468 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Terminating instance
May 14 04:32:39.424995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1827660507',display_name='tempest-TestVolumeBootPattern-server-1827660507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1827660507',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s8ohesr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:27Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=6d19d8f1-482c-495b-bc58-1954cd6be10e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:39.425859 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:39.426459 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:39.427308 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d19d8f1-482c-495b-bc58-1954cd6be10e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:39.700283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.729748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.813472 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.823678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 81 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:32:39.823678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:32:39.877721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:39.910855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.915402 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.930380 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <uuid>6d19d8f1-482c-495b-bc58-1954cd6be10e</uuid>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <name>instance-0000002b</name>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1827660507</nova:name>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:30</nova:creationTime>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <nova:port uuid="4815f088-fcfc-47d4-9242-1dfd0664c117">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="serial">6d19d8f1-482c-495b-bc58-1954cd6be10e</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="uuid">6d19d8f1-482c-495b-bc58-1954cd6be10e</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/disk.config"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <alias name="ua-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <serial>dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4</serial>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <encryption format="luks">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:         <secret type="passphrase" uuid="4f7a5822-482c-485d-b5f5-e73c6ac04e68"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       </encryption>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e5:64:0f"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <target dev="tap4815f088-fc"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/console.log" append="off"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:39.930380 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:39.933244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Preparing to wait for external event network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:32:39.933244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:39.933244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:39.933244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:39.933750 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1827660507',display_name='tempest-TestVolumeBootPattern-server-1827660507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1827660507',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s8ohesr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:27Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=6d19d8f1-482c-495b-bc58-1954cd6be10e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:39.934910 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:39.937054 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:39.937507 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:39.940901 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.941600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.941827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:39.943800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:39.944692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:39.944692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:39.944692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:39.944692 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:39.944692 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-04e62a99-7188-45f7-8373-5170e99c53dd req-b74801b2-bc1b-4f75-a01d-cccdb1e56630 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state active and task_state reboot_started_hard.
May 14 04:32:39.945768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.945768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '290db7a4-594d-5000-a334-fe179d55b24c', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.947652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.947652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:39.963751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.964958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.964958 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4815f088-fc, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.965367 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4815f088-fc, col_values=(('qos', UUID('6a680a8a-2840-45e1-9a35-f6d8b3c580d9')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.965568 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4815f088-fc, col_values=(('external_ids', {'iface-id': '4815f088-fcfc-47d4-9242-1dfd0664c117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:64:0f', 'vm-uuid': '6d19d8f1-482c-495b-bc58-1954cd6be10e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:39.966787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.968384 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:39.980961 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:39.981944 np0000000747 nova-compute[97971]: INFO os_vif [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc')
May 14 04:32:40.096045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.111382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.114134 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.150933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.161280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.231531 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999578811999982 future=<Future at 0x7436184f6810 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:40.235237 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Instance destroyed successfully.
May 14 04:32:40.235759 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'resources' on Instance uuid 8535c256-4cff-4edb-9e78-23028fb7a32d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:40.274518 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.311395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.583696 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found WWN 330000000d0d7656f for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:32:40.584045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:40.584272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000d0d7656f', 'path': '/dev/dm-0', 'multipath_id': '330000000d0d7656f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:40.584433 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d0d7656f', 'path': '/dev/dm-0', 'multipath_id': '330000000d0d7656f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:32:40.588218 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:40.735367 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for dabbc5d1-d4bf-4184-8764-67d80388605d due to new event <LifecycleEvent: 1778733160.7350316, dabbc5d1-d4bf-4184-8764-67d80388605d => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:32:40.735529 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733160.7350316, dabbc5d1-d4bf-4184-8764-67d80388605d => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:40.735717 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Resumed (Lifecycle Event)
May 14 04:32:40.739771 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:32:40.739771 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:30:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056876139',display_name='tempest-AttachVolumeNegativeTest-server-2056876139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-2056876139',id=32,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG43TcIy3yaHbT5oWfseu1uLQFpxsBoeJEf994pXf6HdeRcJxGUM5L2+NTTAbc7TiIQotrpIGLYCVqKOb0wvSUtzi7qxKADOX/zKJLMywgKh4ngHJXvVwK5ZGJN6PblcQ==',key_name='tempest-keypair-437880989',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:30:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-mqf0uvu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=8535c256-4cff-4edb-9e78-23028fb7a32d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:40.740093 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "7b342f78-e288-4c8c-a6af-10acc55dd024", "address": "fa:16:3e:06:14:f3", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b342f78-e2", "ovs_interfaceid": "7b342f78-e288-4c8c-a6af-10acc55dd024", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:40.740548 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:40.740824 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:40.745724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.745929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b342f78-e2, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:40.746945 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.747983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:40.750523 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance rebooted successfully.
May 14 04:32:40.754299 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.755364 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.755579 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=599d65ed-dd50-4b2d-b3ec-eb51e8ae5c8a) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:40.759163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.761008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:40.766149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:40.774205 np0000000747 nova-compute[97971]: INFO os_vif [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:14:f3,bridge_name='br-int',has_traffic_filtering=True,id=7b342f78-e288-4c8c-a6af-10acc55dd024,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b342f78-e2')
May 14 04:32:40.775430 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Deleting instance files /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d_del
May 14 04:32:40.776935 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Deletion of /opt/stack/data/nova/instances/8535c256-4cff-4edb-9e78-23028fb7a32d_del complete
May 14 04:32:41.033536 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00044017200002599566 future=<Future at 0x74361824a8d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:41.034859 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:41.034859 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.0322219370000312 future=<Future at 0x7435f8474c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:41.034859 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.0321235129999877 future=<Future at 0x7435f8474c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:41.034859 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-eb89b371-589e-424e-836f-6667af42560b None None] Emitting event <LifecycleEvent: 1778733146.0329084, 52be42da-de7d-4255-a2d2-84bd69a79605 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:41.036558 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] VM Stopped (Lifecycle Event)
May 14 04:32:41.072698 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:41.091534 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Attempting to attach volume b6fe62fc-bde4-492d-9769-13e0ea883ca3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:32:41.093599 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:   <alias name="ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3"/>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:   <serial>b6fe62fc-bde4-492d-9769-13e0ea883ca3</serial>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]: </disk>
May 14 04:32:41.093599 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:32:41.240268 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:41.247976 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:41.291869 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:32:41.292597 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:41.292766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:41.292865 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:41.293192 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:41.371938 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:41.513983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:41.514108 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:41.514228 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:e5:64:0f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:41.514610 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Using config drive
May 14 04:32:41.538634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eb89b371-589e-424e-836f-6667af42560b None None] [instance: 52be42da-de7d-4255-a2d2-84bd69a79605] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:41.751770 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 14 04:32:41.752164 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733161.7518659, dabbc5d1-d4bf-4184-8764-67d80388605d => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:41.753043 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Started (Lifecycle Event)
May 14 04:32:42.021218 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:42.045343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e3698ee7-852b-4f4d-a625-f1fb97c16f75 req-c96238bf-571e-4d64-ad77-bb2e417a14e9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-deleted-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:42.047743 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-e3698ee7-852b-4f4d-a625-f1fb97c16f75 req-c96238bf-571e-4d64-ad77-bb2e417a14e9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Neutron deleted interface 7b342f78-e288-4c8c-a6af-10acc55dd024; detaching it from the instance and deleting it from the info cache
May 14 04:32:42.047967 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e3698ee7-852b-4f4d-a625-f1fb97c16f75 req-c96238bf-571e-4d64-ad77-bb2e417a14e9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:42.068561 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:42.071179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:42.072149 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:42.073610 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.006954957000061768 future=<Future at 0x7435f8474c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.073772 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.073885 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.617256156999929 future=<Future at 0x7435f83271d0 state=cancelled>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.073992 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.6171506390001014 future=<Future at 0x7435f83271d0 state=cancelled>) was cancelled while queued, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.074491 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733147.0658958, 7000f23a-3a6a-40b1-8346-74d4b436e56a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:42.077134 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] VM Stopped (Lifecycle Event)
May 14 04:32:42.077134 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.077134 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:42.077230 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.153904598000054 future=<Future at 0x7436184f6810 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.077308 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.153741423000156 future=<Future at 0x7436184f6810 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:42.077590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:42.077881 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received unexpected event network-vif-plugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with vm_state active and task_state reboot_started_hard.
May 14 04:32:42.078050 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:42.078289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:42.078467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:42.078631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:42.078786 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] No waiting events found dispatching network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:42.078928 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:42.079058 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:42.079236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Acquiring lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:42.079376 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:42.079741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:42.079741 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] No waiting events found dispatching network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:42.079808 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940f396f-6b90-4260-9c2e-518c7cd7c0fe req-56b555cc-b46b-4caf-bb20-988da3d3089a service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Received event network-vif-unplugged-7b342f78-e288-4c8c-a6af-10acc55dd024 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:42.167020 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Creating config drive at /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/disk.config
May 14 04:32:42.172368 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmsrluyoa {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:42.229884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmsrluyoa" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:42.261068 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:42.267836 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:42.269846 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.269938 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.270057 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.270227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No VIF found with MAC fa:16:3e:dd:c4:26, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:42.271436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:42.428033 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:42.555089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e3698ee7-852b-4f4d-a625-f1fb97c16f75 req-c96238bf-571e-4d64-ad77-bb2e417a14e9 service nova] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Detach interface failed, port_id=7b342f78-e288-4c8c-a6af-10acc55dd024, reason: Instance 8535c256-4cff-4edb-9e78-23028fb7a32d could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:42.583346 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 7000f23a-3a6a-40b1-8346-74d4b436e56a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:42.757819 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:42.772863 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 14 04:32:42.787716 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.789151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.789389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:42.790008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No VIF found with MAC fa:16:3e:91:91:80, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:42.790163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2c0c39f5-5284-4400-ac58-af6ee312e039 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 17.270s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:42.801438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:42.807574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:42.807574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:42.807574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:42.883902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:42.929918 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Took 1.64 seconds to deallocate network for instance.
May 14 04:32:43.103666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:43.106747 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:43.115437 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:43.140451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:43.307645 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:32:43.439822 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:43.440053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:43.888482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:43.965393 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:43.965701 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:44.376240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4ca534a1-1913-43ac-a405-3c19ef273214 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.627s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:44.468861 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:44.479279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a327d3c-610f-43c6-84f5-1ef7a254a9a0 req-15990076-d35f-4875-b676-3f327ee68248 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:44.479505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a327d3c-610f-43c6-84f5-1ef7a254a9a0 req-15990076-d35f-4875-b676-3f327ee68248 service nova] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:44.479730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a327d3c-610f-43c6-84f5-1ef7a254a9a0 req-15990076-d35f-4875-b676-3f327ee68248 service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:44.481385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a327d3c-610f-43c6-84f5-1ef7a254a9a0 req-15990076-d35f-4875-b676-3f327ee68248 service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:44.481385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a327d3c-610f-43c6-84f5-1ef7a254a9a0 req-15990076-d35f-4875-b676-3f327ee68248 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Processing event network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:32:44.550927 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:32:44.552067 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733164.5510397, 6d19d8f1-482c-495b-bc58-1954cd6be10e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:44.552067 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] VM Started (Lifecycle Event)
May 14 04:32:44.555596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:32:44.559356 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance spawned successfully.
May 14 04:32:44.559758 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:32:44.978161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.538s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:44.979949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.092s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:44.986657 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:32:44.986832 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Claim successful on node np0000000747
May 14 04:32:45.046220 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Deleted allocations for instance 8535c256-4cff-4edb-9e78-23028fb7a32d
May 14 04:32:45.054515 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:45.056678 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:45.065910 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.066061 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.066252 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.066446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.066710 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.066903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:45.559594 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:32:45.560205 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733165.5599544, 6d19d8f1-482c-495b-bc58-1954cd6be10e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:45.560354 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] VM Paused (Lifecycle Event)
May 14 04:32:45.574565 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Took 15.46 seconds to spawn the instance on the hypervisor.
May 14 04:32:45.575177 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:45.759884 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:46.058000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c08ed523-1476-4660-89f0-5fcc39d14bd1 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "8535c256-4cff-4edb-9e78-23028fb7a32d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.695s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:46.064995 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:46.072941 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:32:46.075266 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:46.077798 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733166.0775018, 6d19d8f1-482c-495b-bc58-1954cd6be10e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:46.079046 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] VM Resumed (Lifecycle Event)
May 14 04:32:46.088520 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Took 24.73 seconds to build instance.
May 14 04:32:46.495588 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:46.495860 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:46.542522 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:46.542728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.542921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.543044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:46.543216 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] No waiting events found dispatching network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:46.543371 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-cc12a5f1-33b7-4645-a696-3df90d191fcd req-f580fb71-1b37-4637-a500-7578f126de5b service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received unexpected event network-vif-plugged-4815f088-fcfc-47d4-9242-1dfd0664c117 for instance with vm_state active and task_state None.
May 14 04:32:46.581702 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:46.583748 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
May 14 04:32:46.583748 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.584283 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.584802 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.585026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.585581 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.586137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.586559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.586873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.587675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.588402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.590103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.591403 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:46.597191 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.597741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.009s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.598429 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 6d19d8f1-482c-495b-bc58-1954cd6be10e {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.598763 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:32:46.599689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:46.601487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:46.606821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.255s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:46.617590 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 29.54 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:32:47.000871 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:47.097962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.098202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:47.098338 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:47.109459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.521s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.109872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:47.117042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.530s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.117957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.136167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.536s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.265873 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:47.509584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.530s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.510383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:32:47.602750 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] During sync_power_state the instance has a pending task (deleting). Skip.
May 14 04:32:47.603227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.603277 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.338s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:47.603476 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:47.603660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:47.603811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:47.605894 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Terminating instance
May 14 04:32:48.017157 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:32:48.017336 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:32:48.017562 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:48.017811 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:48.111767 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:32:48.119905 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd917914b2414921963ae67e7a9780f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66752be38742a38c2a4ef876561d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:32:48.133918 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.137838 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.160455 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.169030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.192185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.198372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.448946 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.492368 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99968756699991 future=<Future at 0x7435f84332c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:48.495197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.503521 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Instance destroyed successfully.
May 14 04:32:48.505237 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 6d19d8f1-482c-495b-bc58-1954cd6be10e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:48.522356 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:32:48.657336 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:48.657715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:48.657715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:48.657838 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:48.660569 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] No waiting events found dispatching network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:48.661333 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3fadd6e9-9295-450f-be31-a3e1c54ab21c req-5b12d3fb-b86f-42f0-b57f-1aad9eb44c9c service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:48.857898 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.866146 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.869670 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.901283 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Successfully created port: 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:32:48.903468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:48.907968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.008358 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1827660507',display_name='tempest-TestVolumeBootPattern-server-1827660507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1827660507',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:45Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s8ohesr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:46Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=6d19d8f1-482c-495b-bc58-1954cd6be10e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:32:49.008564 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "4815f088-fcfc-47d4-9242-1dfd0664c117", "address": "fa:16:3e:e5:64:0f", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4815f088-fc", "ovs_interfaceid": "4815f088-fcfc-47d4-9242-1dfd0664c117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:49.009254 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:49.009527 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:32:49.013713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.013713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4815f088-fc, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:49.013713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.013713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:49.015238 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.018759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.018926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a680a8a-2840-45e1-9a35-f6d8b3c580d9) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:49.019577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.020216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:49.024526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.026699 np0000000747 nova-compute[97971]: INFO os_vif [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:64:0f,bridge_name='br-int',has_traffic_filtering=True,id=4815f088-fcfc-47d4-9242-1dfd0664c117,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4815f088-fc')
May 14 04:32:49.027960 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:32:49.033383 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.037456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:32:49.040643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:32:49.040643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:32:49.040643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:32:49.040643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:32:49.040643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:32:49.052992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68881191-c410-43fd-8047-67ac9a3d7840 (non-flash)
May 14 04:32:49.087288 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68881191-c410-43fd-8047-67ac9a3d7840 (non-flash)
May 14 04:32:49.087696 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:32:49.087696 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68881191-c410-43fd-8047-67ac9a3d7840', '83')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:32:49.087994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '78')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:49.088929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4', '77')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:32:49.089909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f827bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:32:49.090138 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:32:49.090404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 33000000094bf080b {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:32:49.127500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:49.174189 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:32:49.220970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:32:49.220970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:32:49.222074 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:32:49.239865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:32:49.240383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:32:49.267541 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.313558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.40.100,3260]
May 14 04:32:49.313558 np0000000747 nova-compute[97971]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.40.100,3260] successful.
May 14 04:32:49.313558 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.343676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.365662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.408323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.50.100,3260]
May 14 04:32:49.408323 np0000000747 nova-compute[97971]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-dcd5afd9-6c5e-4008-8b1e-5b6f67afefe4, portal: 192.168.50.100,3260] successful.
May 14 04:32:49.408323 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.428475 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:32:49.429966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:32:49.430126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (392ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:32:49.430296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:32:49.430544 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Deleting instance files /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e_del
May 14 04:32:49.431191 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Deletion of /opt/stack/data/nova/instances/6d19d8f1-482c-495b-bc58-1954cd6be10e_del complete
May 14 04:32:49.622752 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Successfully updated port: 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:32:49.691662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:49.692024 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing instance network info cache due to event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:49.692024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:49.692024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:49.692204 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:49.767229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:49.767757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:49.939340 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Took 1.83 seconds to destroy the instance on the hypervisor.
May 14 04:32:49.939939 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:32:49.940334 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:32:49.940517 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:32:49.940810 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:50.043497 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:32:50.044562 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:32:50.044695 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating image(s)
May 14 04:32:50.045375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:50.045375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:50.045979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:50.046641 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:50.050081 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:50.051286 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:50.105016 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:50.125076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:50.158082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:50.159807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:50.159807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:50.159807 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:50.163636 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:50.163636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:50.196854 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:50.269912 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:32:50.278090 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:50.280811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:50.282665 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:50.356649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk 1073741824" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:50.356649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:50.357161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:50.465864 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4786b836-e089-43a0-9af6-37139e3f1243 req-90d24d11-4395-48a6-9a4a-fd96c73e4ee8 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-deleted-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:50.466055 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-4786b836-e089-43a0-9af6-37139e3f1243 req-90d24d11-4395-48a6-9a4a-fd96c73e4ee8 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Neutron deleted interface 4815f088-fcfc-47d4-9242-1dfd0664c117; detaching it from the instance and deleting it from the info cache
May 14 04:32:50.466243 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4786b836-e089-43a0-9af6-37139e3f1243 req-90d24d11-4395-48a6-9a4a-fd96c73e4ee8 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:50.469425 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:50.469862 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:32:50.470132 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:50.529982 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:50.586450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:50.586822 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Cannot resize image /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:32:50.587420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:32:50.587543 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Ensure instance console log exists: /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:32:50.587909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:50.588137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:50.588360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:50.736778 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:50.739810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] Acquiring lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:50.740070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:50.740241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:50.740452 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] No waiting events found dispatching network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:50.740660 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4b7467c-5f62-4f14-9f8b-94cb09f25275 req-46db78b2-a09e-4065-8f3f-d39b32eafba7 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Received event network-vif-unplugged-4815f088-fcfc-47d4-9242-1dfd0664c117 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:32:50.832561 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:50.832906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:50.839104 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:32:50.839282 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Claim successful on node np0000000747
May 14 04:32:50.900492 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:50.972212 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4786b836-e089-43a0-9af6-37139e3f1243 req-90d24d11-4395-48a6-9a4a-fd96c73e4ee8 service nova] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Detach interface failed, port_id=4815f088-fcfc-47d4-9242-1dfd0664c117, reason: Instance 6d19d8f1-482c-495b-bc58-1954cd6be10e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:32:51.039242 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-66c38dba-c88d-475f-aa42-e97cfdd93701 req-6eee8883-8f11-4472-a583-4aed7444e876 service nova] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:51.039878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:51.040107 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:51.075302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:51.402332 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Took 1.46 seconds to deallocate network for instance.
May 14 04:32:51.626320 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:51.823256 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:51.973674 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Took 0.57 seconds to detach 1 volumes for instance.
May 14 04:32:52.002463 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:52.287737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:52.287932 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:52.479821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:52.504358 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:52.504625 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance network_info: |[{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:32:52.506088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start _get_guest_xml network_info=[{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:52.508123 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:52.509274 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1366242248', uuid='687170c3-d447-4e92-a5cc-979a86a38cd1'), owner=OwnerMeta(userid='bd917914b2414921963ae67e7a9780f1', username='tempest-AttachVolumeShelveTestJSON-1339972729-project-member', projectid='4b66752be38742a38c2a4ef876561d9a', projectname='tempest-AttachVolumeShelveTestJSON-1339972729'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733172.508887) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:52.510242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:52.510548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:52.511253 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:52.511412 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:52.512374 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:52.512685 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:52.512831 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:52.512917 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:52.513034 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:52.513116 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:52.513287 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:52.513470 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:52.513678 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:52.513824 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:52.513919 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:52.514025 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:52.529723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtb9QV4XvuBfnA05emM57/WcWso8r5NPfBec5Tu1J8nYM7V3/ara2n6gEVXGlEjV8TqoijahoZLcyalP/n57ysp6rDOYfUeS2g5hOuOvgVqsXsosTTJa9jm3ccNaIxcOQ==',key_name='tempest-keypair-2120776940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:52.533320 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:52.533869 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:52.535203 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_devices' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:52.791534 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <uuid>687170c3-d447-4e92-a5cc-979a86a38cd1</uuid>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <name>instance-0000002c</name>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1366242248</nova:name>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:52</nova:creationTime>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:user uuid="bd917914b2414921963ae67e7a9780f1">tempest-AttachVolumeShelveTestJSON-1339972729-project-member</nova:user>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:project uuid="4b66752be38742a38c2a4ef876561d9a">tempest-AttachVolumeShelveTestJSON-1339972729</nova:project>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         <nova:port uuid="5ea09587-45ea-4c3a-9c4d-d62f4a6dc453">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="serial">687170c3-d447-4e92-a5cc-979a86a38cd1</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="uuid">687170c3-d447-4e92-a5cc-979a86a38cd1</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:6e:2b:99"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <target dev="tap5ea09587-45"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/console.log" append="off"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:53.041395 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Preparing to wait for external event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:53.041395 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtb9QV4XvuBfnA05emM57/WcWso8r5NPfBec5Tu1J8nYM7V3/ara2n6gEVXGlEjV8TqoijahoZLcyalP/n57ysp6rDOYfUeS2g5hOuOvgVqsXsosTTJa9jm3ccNaIxcOQ==',key_name='tempest-keypair-2120776940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:53.045529 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:53.045529 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:53.045529 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:53.045799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.046065 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:53.046307 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:53.047044 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.047227 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375cbffa-6214-598a-808a-a2ae18e32836', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:53.048127 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.048751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:53.049331 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.051315 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.051446 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea09587-45, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:53.051774 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ea09587-45, col_values=(('qos', UUID('b7214ffb-cac9-43ec-a29c-a4a686734769')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:53.051921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ea09587-45, col_values=(('external_ids', {'iface-id': '5ea09587-45ea-4c3a-9c4d-d62f4a6dc453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2b:99', 'vm-uuid': '687170c3-d447-4e92-a5cc-979a86a38cd1'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:53.052751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.053912 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:53.059933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:53.061244 np0000000747 nova-compute[97971]: INFO os_vif [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45')
May 14 04:32:53.299060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.466s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:53.299798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.820s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:53.299955 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:32:53.767555 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:32:53.767797 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:32:53.806442 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:32:53.809641 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:32:53.809641 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:53.809641 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:53.905325 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d28aa2d5d8d4d42931857f8b63ad188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1481ce79a54b72a2f83aa185ea46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:32:54.273138 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:32:54.312712 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:32:54.402942 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Successfully created port: c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:32:54.584636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:54.584832 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:54.584992 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No VIF found with MAC fa:16:3e:6e:2b:99, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:54.585561 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Using config drive
May 14 04:32:54.782192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.482s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:54.822649 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:32:54.853073 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 6d19d8f1-482c-495b-bc58-1954cd6be10e
May 14 04:32:55.016140 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Successfully updated port: c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:32:55.065520 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-changed-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:55.065950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Refreshing instance network info cache due to event network-changed-c3e32337-e309-4b1c-817c-e6eb0af52770. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:32:55.066185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] Acquiring lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:55.066336 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] Acquired lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:55.066492 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Refreshing network info cache for port c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:32:55.092671 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:55.231581 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00047410599995600933 future=<Future at 0x7436184f6810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:55.231786 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:55.231917 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.260199992000025 future=<Future at 0x7435f84332c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:55.231977 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=8.260038219999842 future=<Future at 0x7435f84332c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:32:55.232399 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Emitting event <LifecycleEvent: 1778733160.2309816, 8535c256-4cff-4edb-9e78-23028fb7a32d => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:55.232583 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] VM Stopped (Lifecycle Event)
May 14 04:32:55.289277 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating config drive at /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config
May 14 04:32:55.295046 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpti201_c0 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:55.352775 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpti201_c0" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:55.520287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:32:55.571134 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:55.654381 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:55.738547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-efea92ff-69d7-4c3a-8eb0-b46650c94d68 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 8535c256-4cff-4edb-9e78-23028fb7a32d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:55.800362 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:55.842502 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:32:55.842972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:32:55.843384 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Creating image(s)
May 14 04:32:55.844285 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:55.844648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:55.845261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:55.845950 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:55.850753 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:55.853697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:55.886641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f7137f1b-7555-4330-a854-6304359dc99c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "6d19d8f1-482c-495b-bc58-1954cd6be10e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:55.939592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:55.968325 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:55.972599 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:55.976921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.125s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:55.979245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:55.979767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:55.980261 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:55.985320 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:32:55.985320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:56.061730 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.079222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.125042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.140s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:56.126042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:56.199417 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk 1073741824" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:56.200096 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:56.200529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:56.222525 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-53a9e9fe-0a4c-4748-8920-578a4aa6ff69 req-2b6be029-0770-4be0-bf3b-261ec4cd28a6 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:56.222935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a9e9fe-0a4c-4748-8920-578a4aa6ff69 req-2b6be029-0770-4be0-bf3b-261ec4cd28a6 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:56.223359 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a9e9fe-0a4c-4748-8920-578a4aa6ff69 req-2b6be029-0770-4be0-bf3b-261ec4cd28a6 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:56.224840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-53a9e9fe-0a4c-4748-8920-578a4aa6ff69 req-2b6be029-0770-4be0-bf3b-261ec4cd28a6 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:56.224840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-53a9e9fe-0a4c-4748-8920-578a4aa6ff69 req-2b6be029-0770-4be0-bf3b-261ec4cd28a6 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Processing event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:32:56.307530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b1c7697c-4deb-4380-9147-7ed8c2139998 req-3dd622de-63a2-4788-8cbf-036acf6d843b service nova] Releasing lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:56.310064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquired lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:32:56.310365 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:32:56.322989 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.327842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.332459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.333341 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.132s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:56.334394 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:32:56.335136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:32:56.361426 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:56.469353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:32:56.469885 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Cannot resize image /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:32:56.470558 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:32:56.472093 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Ensure instance console log exists: /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:32:56.472478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:56.472803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:56.473000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:56.903749 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:32:56.966258 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733176.9658399, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:56.968730 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:32:56.970653 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Started (Lifecycle Event)
May 14 04:32:56.973642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:32:56.974082 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance spawned successfully.
May 14 04:32:56.974493 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:32:57.132997 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:32:57.292630 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating instance_info_cache with network_info: [{"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:32:57.473836 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:57.478043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:57.497353 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.497353 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.497353 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.499098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.499098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.499098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:32:57.798050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Releasing lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:32:57.798488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance network_info: |[{"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:32:57.801030 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Start _get_guest_xml network_info=[{"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:32:57.803868 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:32:57.805447 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-361255871', uuid='c89476d9-d45d-46db-86c5-12165dc40a93'), owner=OwnerMeta(userid='6d28aa2d5d8d4d42931857f8b63ad188', username='tempest-AttachVolumeNegativeTest-2053621712-project-member', projectid='9e1481ce79a54b72a2f83aa185ea46d1', projectname='tempest-AttachVolumeNegativeTest-2053621712'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733177.8049495) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:32:57.806801 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:32:57.807281 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:32:57.808577 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:32:57.808815 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:32:57.810218 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:32:57.810673 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:32:57.811405 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:32:57.811405 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:32:57.811405 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:32:57.811405 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:32:57.811728 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:32:57.814041 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:32:57.815875 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:32:57.816074 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:32:57.816327 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:32:57.816519 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:32:57.841603 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-361255871',display_name='tempest-AttachVolumeNegativeTest-server-361255871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-361255871',id=45,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChQCa4Gz8Vzk2YZy9I5NKj8FGgD53Kvc02Y5rsdJkj1OFTq7LWlOTvCwKbm8t4QVgIF+IyV172gJSQ1OjYkpA+kYefj22vvHEwYc/EiKTRK4kzybdxLeu5eEloZ6szgXg==',key_name='tempest-keypair-791235995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-n80tx1pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=c89476d9-d45d-46db-86c5-12165dc40a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:32:57.841890 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:57.842455 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:57.843490 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'pci_devices' on Instance uuid c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:32:57.982703 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:32:57.983017 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733177.9827988, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:57.983176 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Paused (Lifecycle Event)
May 14 04:32:58.008004 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Took 7.96 seconds to spawn the instance on the hypervisor.
May 14 04:32:58.008295 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:58.059057 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.281640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:32:58.282187 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:58.282929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:58.285004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:58.285270 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:32:58.285474 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0510cef7-6516-4cec-bd76-9f9dcd123f4e req-6920735a-9516-41cd-92c6-2c8373dfbf5c service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received unexpected event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with vm_state active and task_state None.
May 14 04:32:58.346759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] End _get_guest_xml xml=<domain type="qemu">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <uuid>c89476d9-d45d-46db-86c5-12165dc40a93</uuid>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <name>instance-0000002d</name>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeNegativeTest-server-361255871</nova:name>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:32:57</nova:creationTime>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:user uuid="6d28aa2d5d8d4d42931857f8b63ad188">tempest-AttachVolumeNegativeTest-2053621712-project-member</nova:user>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:project uuid="9e1481ce79a54b72a2f83aa185ea46d1">tempest-AttachVolumeNegativeTest-2053621712</nova:project>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         <nova:port uuid="c3e32337-e309-4b1c-817c-e6eb0af52770">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <system>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="serial">c89476d9-d45d-46db-86c5-12165dc40a93</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="uuid">c89476d9-d45d-46db-86c5-12165dc40a93</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </system>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <os>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </os>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <features>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </features>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   <devices>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.config"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </disk>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:aa:e8:e0"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <target dev="tapc3e32337-e3"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </interface>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/console.log" append="off"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </serial>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <video>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </video>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </rng>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:   </devices>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]: </domain>
May 14 04:32:58.346759 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Preparing to wait for external event network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-361255871',display_name='tempest-AttachVolumeNegativeTest-server-361255871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-361255871',id=45,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChQCa4Gz8Vzk2YZy9I5NKj8FGgD53Kvc02Y5rsdJkj1OFTq7LWlOTvCwKbm8t4QVgIF+IyV172gJSQ1OjYkpA+kYefj22vvHEwYc/EiKTRK4kzybdxLeu5eEloZ6szgXg==',key_name='tempest-keypair-791235995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-n80tx1pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=c89476d9-d45d-46db-86c5-12165dc40a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.349819 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:58.350595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:32:58.351062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.351374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd22f17f5-312b-5369-bf17-7cabfe5f686f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:58.354642 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.355187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:58.358209 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.361501 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.362092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3e32337-e3, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:58.362533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3e32337-e3, col_values=(('qos', UUID('f5ef024a-41dd-473c-b3bb-36100d1424b9')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:58.362984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3e32337-e3, col_values=(('external_ids', {'iface-id': 'c3e32337-e309-4b1c-817c-e6eb0af52770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:e8:e0', 'vm-uuid': 'c89476d9-d45d-46db-86c5-12165dc40a93'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:32:58.365465 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.367179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:32:58.374407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:32:58.375539 np0000000747 nova-compute[97971]: INFO os_vif [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3')
May 14 04:32:58.488565 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:58.493860 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733178.4925609, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:32:58.493860 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Resumed (Lifecycle Event)
May 14 04:32:58.517643 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Took 14.71 seconds to build instance.
May 14 04:32:58.995819 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:32:59.000188 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:32:59.019297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.215s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:59.019881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.910s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:32:59.535911 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.516s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:32:59.910112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:59.910112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:32:59.910112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:aa:e8:e0, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:32:59.910609 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Using config drive
May 14 04:33:00.420478 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:00.432301 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:00.432497 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing instance network info cache due to event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:00.432587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:00.435284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:00.435522 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:00.539675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:00.540195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:00.579497 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Creating config drive at /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.config
May 14 04:33:00.585100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4jrxx5v0 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:00.639319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4jrxx5v0" returned: 0 in 0.054s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:00.941340 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:01.043707 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:33:01.067391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.097604 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.102559 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.236663 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.395180 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:01.469595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.479175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.502848 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:01.585357 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updated VIF entry in instance network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:01.585921 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:01.609484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:01.609715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:01.612846 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:33:01.612969 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Claim successful on node np0000000747
May 14 04:33:01.978553 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733181.9780803, c89476d9-d45d-46db-86c5-12165dc40a93 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:01.978868 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] VM Started (Lifecycle Event)
May 14 04:33:02.087583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7b28d540-fcbd-4b76-b7af-65645ac18446 req-e0a7280e-c7d4-4f36-877c-101033420361 service nova] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:02.482152 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:02.483575 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733182.48332, c89476d9-d45d-46db-86c5-12165dc40a93 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:02.484049 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] VM Paused (Lifecycle Event)
May 14 04:33:02.510633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:02.511113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Processing event network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] No waiting events found dispatching network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ec7d050a-c866-4b2d-80ee-125a722de19f req-0fbeec67-f6c2-4dab-8a85-b9ec162d6cea service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received unexpected event network-vif-plugged-c3e32337-e309-4b1c-817c-e6eb0af52770 for instance with vm_state building and task_state spawning.
May 14 04:33:02.514210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:02.518240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:02.521281 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance spawned successfully.
May 14 04:33:02.521578 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:33:02.987128 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:02.991301 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733182.990982, c89476d9-d45d-46db-86c5-12165dc40a93 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:02.991446 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] VM Resumed (Lifecycle Event)
May 14 04:33:03.033605 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.033751 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.034079 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.034329 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.035047 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.035047 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:03.164365 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:03.164859 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:03.365079 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:03.492466 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004057160001593729 future=<Future at 0x7435f84332c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:03.492565 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:03.492861 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733168.4919598, 6d19d8f1-482c-495b-bc58-1954cd6be10e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:03.492997 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] VM Stopped (Lifecycle Event)
May 14 04:33:03.498980 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:03.500790 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:03.539213 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Took 7.70 seconds to spawn the instance on the hypervisor.
May 14 04:33:03.539889 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:03.668347 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:03.998302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0ba20198-2530-4727-8c3d-0f17b473e9cc tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 6d19d8f1-482c-495b-bc58-1954cd6be10e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:04.002865 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:33:04.050348 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Took 13.27 seconds to build instance.
May 14 04:33:04.179541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.570s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:04.179882 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:33:04.551747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:04.553268 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.784s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:04.555059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:04.686586 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:33:04.686794 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:33:04.687123 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:04.687468 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:04.754824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-changed-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:04.754824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Refreshing instance network info cache due to event network-changed-c3e32337-e309-4b1c-817c-e6eb0af52770. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:04.754824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] Acquiring lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:04.754824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] Acquired lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:04.754824 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Refreshing network info cache for port c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:04.792210 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:33:05.057786 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Detaching volume b6fe62fc-bde4-492d-9769-13e0ea883ca3
May 14 04:33:05.105568 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Attempting to driver detach volume b6fe62fc-bde4-492d-9769-13e0ea883ca3 from mountpoint /dev/vdb
May 14 04:33:05.112916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found disk vdb by alias ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:05.114703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found disk vdb by alias ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:05.114822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Attempting to detach device vdb from instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:33:05.115060 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <alias name="ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3"/>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <serial>b6fe62fc-bde4-492d-9769-13e0ea883ca3</serial>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:05.115060 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:05.122295 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully detached device vdb from instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 from the persistent domain config.
May 14 04:33:05.122403 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] (1/8): Attempting to detach device vdb with device alias ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3 from instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:33:05.122622 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <alias name="ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3"/>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <serial>b6fe62fc-bde4-492d-9769-13e0ea883ca3</serial>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:05.122622 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:05.188714 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:33:05.256960 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:05.360497 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Successfully created port: 0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:33:05.662036 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:05.693632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:33:05.699287 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733185.6989264, d38c474f-806e-4b2f-9a7f-4f25dda0ff88 => ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:33:05.699504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6fe62fc-bde4-492d-9769-13e0ea883ca3 for instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:33:05.705013 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully detached device vdb from instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 from the live domain config.
May 14 04:33:05.708650 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:05.709638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:05.709638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:05.709638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:05.709909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6fe62fc-bde4-492d-9769-13e0ea883ca3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:05.710049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:33:05.746898 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3 (non-flash)
May 14 04:33:05.749689 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '82')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:05.749689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '81')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:05.754548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3', '82')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:05.756657 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436183925c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:05.756657 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:05.757781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flush multipath device 330000000d0d7656f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:05.799253 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:05.853786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:05.888261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:05.888454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:05.889553 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:05.904823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:05.905104 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:05.922048 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:05.969646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.40.100,3260]
May 14 04:33:05.969646 np0000000747 nova-compute[97971]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.40.100,3260] successful.
May 14 04:33:05.969646 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:05.973930 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updated VIF entry in instance network info cache for port c3e32337-e309-4b1c-817c-e6eb0af52770. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:05.974335 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating instance_info_cache with network_info: [{"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:05.994574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:06.008460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:06.048097 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Successfully updated port: 0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:33:06.049019 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.50.100,3260]
May 14 04:33:06.049019 np0000000747 nova-compute[97971]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-b6fe62fc-bde4-492d-9769-13e0ea883ca3, portal: 192.168.50.100,3260] successful.
May 14 04:33:06.049019 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:06.070168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:06.074649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:06.074649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== disconnect_volume: return (362ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:06.074649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:06.105374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:06.199184 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Booting with volume 4fe8750e-120f-4ef2-af98-a077d620f9f2 at /dev/vda
May 14 04:33:06.255227 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:06.271451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:06.298804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:06.350223 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:06.351538 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe91:9180', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627', 'fe80::fc16:3eff:fe05:ebaf', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe6e:2b99', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f'] 
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:06.364698 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updating existing volume attachment record: 4fd83065-cd3c-4451-9738-28f77ed64bd0 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:06.480688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0126e6cc-693b-4d81-8dd3-7bf970b5f008 req-96613427-9d6a-4f66-9d4e-b7afcf822bf4 service nova] Releasing lock "refresh_cache-c89476d9-d45d-46db-86c5-12165dc40a93" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:06.551275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:06.551447 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:06.551636 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:33:06.635496 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:06.820669 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-changed-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:06.821384 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Refreshing instance network info cache due to event network-changed-0a0b47d9-6314-4f3f-85be-8b79cf058989. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:06.821566 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] Acquiring lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:06.916638 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Rebuilding instance
May 14 04:33:07.103293 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:07.132202 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:33:07.354551 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:07.574106 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updating instance_info_cache with network_info: [{"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:07.642549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1dd567f5-5089-4b6f-a4fe-ee618e9f3c11 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.089s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:07.856217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:07.856474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:07.856686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:07.856841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:07.856982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:07.862217 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Terminating instance
May 14 04:33:08.079751 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:08.080040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Instance network_info: |[{"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:33:08.080588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] Acquired lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:08.081004 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Refreshing network info cache for port 0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:08.138033 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.142706 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.166953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.174740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.206734 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.365824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.368017 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:08.403989 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.435117 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.470597 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999585314999877 future=<Future at 0x74361822a6c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:08.474494 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.996717367999963 future=<Future at 0x74361822a6c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:08.474494 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.996528575999946 future=<Future at 0x74361822a6c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:08.474494 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.479638 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance destroyed successfully.
May 14 04:33:08.499640 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance destroyed successfully.
May 14 04:33:08.499947 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1976191561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:26Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:08.500206 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:08.502482 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:08.502482 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:08.503481 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.503595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a85c8c7-f3, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:08.504777 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.506962 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:08.520666 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:33:08.522238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:33:08.522568 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Creating image(s)
May 14 04:33:08.522904 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:33:08.523175 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Ensure instance console log exists: /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:33:08.523465 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:08.523790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:08.523845 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:08.524418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Start _get_guest_xml network_info=[{"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4fd83065-cd3c-4451-9738-28f77ed64bd0', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51ef8d74-823f-4db8-8212-4f2d20327524', 'attached_at': '', 'detached_at': '', 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'serial': '4fe8750e-120f-4ef2-af98-a077d620f9f2'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:33:08.524915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.526228 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.526228 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f82c779-295d-4165-af85-13ffbcc789c3) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:08.527624 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.528690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:08.535378 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.536471 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:33:08.539740 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1854009623', uuid='51ef8d74-823f-4db8-8212-4f2d20327524'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733188.537888) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:33:08.542218 np0000000747 nova-compute[97971]: INFO os_vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3')
May 14 04:33:08.545026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:33:08.545445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:33:08.550233 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:08.551505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:08.551505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:08.551505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:08.551811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:08.552416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:08.552530 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:33:08.555472 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:33:08.555844 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:33:08.555844 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:33:08.556331 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:33:08.556483 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:33:08.556710 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:33:08.576059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:08.576478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:08.576646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:08.584423 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:08.591666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:08.591666 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:08.591666 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:08.591666 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:08.591666 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:08.591982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:08.591982 np0000000747 nova-compute[97971]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:08.591982 np0000000747 nova-compute[97971]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:08.591982 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:08.591982 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:08.591982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:08.592247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '76')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:08.596819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '75')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:08.596819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361827b060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:08.596819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:08.596819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flush multipath device 330000000f525beb2 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:08.655678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:08.660024 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:08.660024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:08.660220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:08.660344 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:08.660478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] No waiting events found dispatching network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:08.661284 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7c78cc15-f6b4-45f7-b937-39c3fa6910b0 req-02950605-6600-45c3-86fe-57266bddcd43 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:08.705351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:08.717873 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.731644 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:08.747817 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99945318899995 future=<Future at 0x7435f840ac90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:08.750311 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Instance destroyed successfully.
May 14 04:33:08.750907 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'resources' on Instance uuid d38c474f-806e-4b2f-9a7f-4f25dda0ff88 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:08.756922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:08.756922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:08.756922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:08.769925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:08.770142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:08.783480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.816902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260]
May 14 04:33:08.816902 np0000000747 nova-compute[97971]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260] successful.
May 14 04:33:08.816902 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.833966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.849983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.881669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260]
May 14 04:33:08.881669 np0000000747 nova-compute[97971]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260] successful.
May 14 04:33:08.881669 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.898696 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.898957 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:08.902353 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== disconnect_volume: return (351ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:08.903105 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.326s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:08.903893 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deleting instance files /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a_del
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:08.909397 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:08.910088 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received unexpected event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with vm_state active and task_state rebuilding.
May 14 04:33:08.910088 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:08.910088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:08.910088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:08.910088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:08.910371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:08.910371 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-1a20bfde-b4b8-4bf6-a70a-f5dd9a4a11ed req-94963078-c903-4c69-beb8-67db1f020222 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received unexpected event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with vm_state active and task_state rebuilding.
May 14 04:33:08.914579 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deletion of /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a_del complete
May 14 04:33:08.922838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:08.924410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:08.929658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:08.930156 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:08.931077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:08.931330 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:08.945083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:08.945083 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.946823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:08.946823 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.962514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2] added
May 14 04:33:08.962514 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:08.962514 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:08.962514 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:08.962514 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:08.962514 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:08.962514 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.963506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:08.963506 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:08.963506 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:08.974133 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2] added
May 14 04:33:08.974133 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:08.974133 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:08.974133 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:08.974133 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:08.974133 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:08.974133 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:08.974440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:08.974711 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:08.974711 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:08.993228 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:09.132399 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updated VIF entry in instance network info cache for port 0a0b47d9-6314-4f3f-85be-8b79cf058989. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:09.132694 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updating instance_info_cache with network_info: [{"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:09.254764 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2120857660',display_name='tempest-VolumesBackupsTest-instance-2120857660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-2120857660',id=40,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLQ8EdOALVOIAocWLTrESktlt3rCuqwPuFmiZ7X9oCtFfsO9TzmyIyaBQUFBBpbgheZkz13CEpnV2OAng7cTCYkcn0ernYEcIDEMeK6Jo4SCB1dZ9n7u36Lu/74e0XXzg==',key_name='tempest-keypair-1412599027',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:55Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-z0971mkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=d38c474f-806e-4b2f-9a7f-4f25dda0ff88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:09.255402 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "55aa4c08-878a-45fa-a989-21138711901c", "address": "fa:16:3e:91:91:80", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55aa4c08-87", "ovs_interfaceid": "55aa4c08-878a-45fa-a989-21138711901c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:09.255570 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:09.255783 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:09.256795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.257040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55aa4c08-87, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:09.258058 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.260208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:09.260208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.260530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.260723 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=894a0eec-fc3a-4509-9300-7c11918e3ca1) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:09.262629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.262629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:09.262629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:09.264143 np0000000747 nova-compute[97971]: INFO os_vif [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:91:80,bridge_name='br-int',has_traffic_filtering=True,id=55aa4c08-878a-45fa-a989-21138711901c,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55aa4c08-87')
May 14 04:33:09.264470 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Deleting instance files /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88_del
May 14 04:33:09.265365 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Deletion of /opt/stack/data/nova/instances/d38c474f-806e-4b2f-9a7f-4f25dda0ff88_del complete
May 14 04:33:09.491830 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 78a47990-a6d1-4617-8c1c-538889b9f34a could not be found.
May 14 04:33:09.492771 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:09.493024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:09.493151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:09.634558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6f7a9294-7ef5-4f73-a022-0130b71b1f22 req-8c63de57-dde3-4765-9654-b92b93675525 service nova] Releasing lock "refresh_cache-51ef8d74-823f-4db8-8212-4f2d20327524" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:09.771810 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:33:09.772352 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:33:09.772559 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:33:09.772672 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:33:09.772931 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:09.852876 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:09.963905 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:09.975423 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:09.978856 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:09.978856 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:09.992878 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:09.992878 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.001640 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.016092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.018306 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.018306 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.018306 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:10.018552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.018552 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.018552 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:10.043277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.043277 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.043277 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:10.043277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.043277 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.043277 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:10.061350 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.40.100,3260]
May 14 04:33:10.061350 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.40.100,3260] successful.
May 14 04:33:10.061350 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.075185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.50.100,3260]
May 14 04:33:10.075185 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.50.100,3260] successful.
May 14 04:33:10.075185 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.079106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.095259 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:10.105165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.105165 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.105165 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.105165 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.105165 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:10.105504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.105504 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.105504 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.105504 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.105504 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:10.105815 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:10.106005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:10.106869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('7', '-', '-', 0) found on session 84 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:10.107051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:10.116786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.116786 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.116786 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.116786 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.116786 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:10.118334 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:10.118334 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:10.119465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('8', '-', '-', 0) found on session 85 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:10.120258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:10.127792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 84 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:10.127948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:10.145573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 85 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:10.145573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:10.725782 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:10.726238 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] Acquiring lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:10.726238 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:10.726840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:10.726840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] No waiting events found dispatching network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:10.726840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-unplugged-55aa4c08-878a-45fa-a989-21138711901c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:10.726840 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Received event network-vif-deleted-55aa4c08-878a-45fa-a989-21138711901c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:10.727051 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Neutron deleted interface 55aa4c08-878a-45fa-a989-21138711901c; detaching it from the instance and deleting it from the info cache
May 14 04:33:10.727198 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:10.883607 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:10.926453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:33:11.104712 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:11.231665 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-69ee8e5e-771d-4434-95b0-505524b1caf9 req-d731958f-fa1b-4d44-aaa8-db24ce2b8631 service nova] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Detach interface failed, port_id=55aa4c08-878a-45fa-a989-21138711901c, reason: Instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:33:11.386085 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Took 1.61 seconds to deallocate network for instance.
May 14 04:33:11.894836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:11.895421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:11.947981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 330000000e461d300 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:33:11.947981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:11.948509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.455s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:11.948909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:11.949071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:11.950834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3373ms) {'type': 'block', 'scsi_wwn': '330000000e461d300', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e461d300'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:11.950834 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e461d300', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e461d300'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:33:11.979239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:11.979239 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:11.979239 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:11.979239 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:11.979239 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:11.979458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:11.979458 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:11.979458 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:11.979458 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:11.979458 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:11.979602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '85')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:11.979731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:11.979857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:33:11.979957 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:11.980046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a') {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 14 04:33:11.980170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184cc4a0>, {}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:11.980331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Disconnecting from: [] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:11.980579 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:11.980710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== disconnect_volume: return (2487ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:11.980822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:11.999062 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '51ef8d74-823f-4db8-8212-4f2d20327524', 'attached_at': '', 'detached_at': '', 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'serial': '4fe8750e-120f-4ef2-af98-a077d620f9f2'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:33:11.999062 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:33:11.999062 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:33:11.999062 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:33:12.000170 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x74361849e8a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '51ef8d74-823f-4db8-8212-4f2d20327524', 'attached_at': '', 'detached_at': '', 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'serial': '4fe8750e-120f-4ef2-af98-a077d620f9f2'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:33:12.000520 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97971) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 04:33:12.001214 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] opening encrypted volume /dev/dm-0 {{(pid=97971) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 04:33:12.045673 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.luks [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 04:33:12.046449 np0000000747 nova-compute[97971]: INFO os_brick.encryptors.luks [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 14 04:33:12.046449 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] formatting encrypted volume /dev/dm-0 {{(pid=97971) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 04:33:12.477981 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:12.478129 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:12.487463 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:12.487904 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:12.982936 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:12.993254 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:13.139586 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Preparing to wait for external event volume-reimaged-46977d6c-2c67-43ce-a101-9ed5481c354a {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:33:13.139711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:13.139857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:13.140031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:13.501151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.606s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:13.590723 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Deleted allocations for instance d38c474f-806e-4b2f-9a7f-4f25dda0ff88
May 14 04:33:13.992730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:14.267986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:14.600335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e49ab81-a62c-4e83-8869-15900bbd15b7 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "d38c474f-806e-4b2f-9a7f-4f25dda0ff88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.744s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:15.167527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:15.167527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:15.167527 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Attaching volume a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d to /dev/vdb
May 14 04:33:15.268219 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:15.302829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:15.350790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:15.400042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:15.400929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:15.413890 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:15.415602 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe05:ebaf', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe6e:2b99', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f'] 
May 14 04:33:15.415780 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:15.415918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:15.416224 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:15.416797 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating existing volume attachment record: 77cdd0d8-caca-4471-a96e-58a1aa27313d {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:16.028548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:16.028854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:16.029166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:16.107414 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:16.155690 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:16.155690 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.45 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:16.610311 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:16.613960 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:16.984554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.955s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:16.984817 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:17.013976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:17.014567 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:17.014884 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:17.023945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:17.023945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:17.023945 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:17.036133 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:17.036133 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:17.048336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:17.048336 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d] added
May 14 04:33:17.057154 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:17.057154 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:17.057154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:17.057782 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:17.057782 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:17.062916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d] added
May 14 04:33:17.062916 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:17.062916 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:17.062916 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:17.062916 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:17.062916 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:17.062916 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:17.063180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:17.066596 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:17.067118 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:18.067233 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:18.075654 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:18.086199 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:18.086199 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:18.093714 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:18.093714 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.105294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.108444 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.131132 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.131324 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.137501 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:18.189160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.50.100,3260]
May 14 04:33:18.189160 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.50.100,3260] successful.
May 14 04:33:18.189160 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.202097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.40.100,3260]
May 14 04:33:18.202097 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.40.100,3260] successful.
May 14 04:33:18.202097 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.209134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.233017 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.233749 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.235188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:18.235188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:18.236072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] HCTL ('11', '-', '-', 0) found on session 88 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:18.236409 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.256945 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:18.257220 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:18.258445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.243s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:18.258445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:18.261396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching for a device in session 88 and hctl ['11', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:18.261396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] HCTL ('12', '-', '-', 0) found on session 89 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:18.261396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:18.276362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:18.276362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:19.260462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Searching for a device in session 88 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:19.260990 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:19.272903 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:19.612310 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:19.613072 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:20.054740 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found WWN 330000000cc5b34a7 for multipath device dm-5 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:33:20.055180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.071s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:20.055501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== connect_volume: return (4026ms) {'type': 'block', 'scsi_wwn': '330000000cc5b34a7', 'path': '/dev/dm-5', 'multipath_id': '330000000cc5b34a7'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:20.055644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc5b34a7', 'path': '/dev/dm-5', 'multipath_id': '330000000cc5b34a7'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:33:20.068083 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:20.240040 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] opening encrypted volume /dev/dm-0 {{(pid=97971) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 04:33:20.574938 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Attempting to attach volume a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:33:20.582663 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:   <alias name="ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d"/>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:   <serial>a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d</serial>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:20.582663 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:33:20.602064 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:20.602575 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:20.610011 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:20.610435 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:21.109648 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:21.116211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:21.116512 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:21.116750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:21.116962 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:33:21.211279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:21.214531 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing instance network info cache due to event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:21.214664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:21.214764 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:21.214924 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:21.721865 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:22.149154 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:22.180907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.279130 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:22.279274 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:22.279437 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:22.279602 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] No VIF found with MAC fa:16:3e:05:eb:af, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:22.290120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.290222 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.323843 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updated VIF entry in instance network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:22.325127 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:22.405303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.405743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:33:22.407983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.524364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.524692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.566004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:22.568711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:22.630304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.634265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.734287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.735168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.828276 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-506db990-e938-4733-9e76-be68b0f02703 req-a6a80403-0ef7-428e-adcd-3a6086bfbc16 service nova] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:22.842407 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.847389 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:22.878725 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854009623',display_name='tempest-TestVolumeBootPattern-server-1854009623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1854009623',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-0qaecj3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:06Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=51ef8d74-823f-4db8-8212-4f2d20327524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:33:22.879082 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:22.880542 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:22.882878 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 51ef8d74-823f-4db8-8212-4f2d20327524 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:22.943895 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:22.944536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:23.053983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:23.061029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:23.082140 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Detaching volume 703750fc-3974-4b36-a16d-1d5b8ab367f7
May 14 04:33:23.137187 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Attempting to driver detach volume 703750fc-3974-4b36-a16d-1d5b8ab367f7 from mountpoint /dev/vdb
May 14 04:33:23.146826 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found disk vdb by alias ua-703750fc-3974-4b36-a16d-1d5b8ab367f7 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:23.148385 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found disk vdb by alias ua-703750fc-3974-4b36-a16d-1d5b8ab367f7 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:23.151050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Attempting to detach device vdb from instance dabbc5d1-d4bf-4184-8764-67d80388605d from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:33:23.151050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <alias name="ua-703750fc-3974-4b36-a16d-1d5b8ab367f7"/>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <serial>703750fc-3974-4b36-a16d-1d5b8ab367f7</serial>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:23.151050 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:23.155307 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully detached device vdb from instance dabbc5d1-d4bf-4184-8764-67d80388605d from the persistent domain config.
May 14 04:33:23.156103 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] (1/8): Attempting to detach device vdb with device alias ua-703750fc-3974-4b36-a16d-1d5b8ab367f7 from instance dabbc5d1-d4bf-4184-8764-67d80388605d from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:33:23.156307 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <alias name="ua-703750fc-3974-4b36-a16d-1d5b8ab367f7"/>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <serial>703750fc-3974-4b36-a16d-1d5b8ab367f7</serial>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:23.156307 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:23.157936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:23.158377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:23.207580 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-556db790-64fc-417b-9a18-9e5cf9ceb6ca req-f83cb9ce-65d9-42c3-baf9-483325eefd13 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event volume-reimaged-46977d6c-2c67-43ce-a101-9ed5481c354a {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:23.217737 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-556db790-64fc-417b-9a18-9e5cf9ceb6ca req-f83cb9ce-65d9-42c3-baf9-483325eefd13 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:23.217936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-556db790-64fc-417b-9a18-9e5cf9ceb6ca req-f83cb9ce-65d9-42c3-baf9-483325eefd13 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:23.218082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-556db790-64fc-417b-9a18-9e5cf9ceb6ca req-f83cb9ce-65d9-42c3-baf9-483325eefd13 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:23.218204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-556db790-64fc-417b-9a18-9e5cf9ceb6ca req-f83cb9ce-65d9-42c3-baf9-483325eefd13 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Processing event volume-reimaged-46977d6c-2c67-43ce-a101-9ed5481c354a {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:23.221637 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance event wait completed in 9 seconds for volume-reimaged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:23.251533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:23.251933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:33:23.259469 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:33:23.260905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:23.302632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:23.307716 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing instance network info cache due to event network-changed-05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:23.308097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] Acquiring lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:23.308724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] Acquired lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:23.308964 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Refreshing network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:23.331470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:23.332121 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=11396MB free_disk=72.99271774291992GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:33:23.332423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:23.332712 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:23.389845 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] End _get_guest_xml xml=<domain type="qemu">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <uuid>51ef8d74-823f-4db8-8212-4f2d20327524</uuid>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <name>instance-0000002e</name>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1854009623</nova:name>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:33:08</nova:creationTime>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         <nova:port uuid="0a0b47d9-6314-4f3f-85be-8b79cf058989">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <system>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="serial">51ef8d74-823f-4db8-8212-4f2d20327524</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="uuid">51ef8d74-823f-4db8-8212-4f2d20327524</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </system>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <os>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </os>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <features>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </features>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   <devices>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/disk.config"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <alias name="ua-4fe8750e-120f-4ef2-af98-a077d620f9f2"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <serial>4fe8750e-120f-4ef2-af98-a077d620f9f2</serial>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:57:38"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <target dev="tap0a0b47d9-63"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </interface>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/console.log" append="off"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </serial>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <video>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </video>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </rng>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:   </devices>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]: </domain>
May 14 04:33:23.389845 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Preparing to wait for external event network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854009623',display_name='tempest-TestVolumeBootPattern-server-1854009623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1854009623',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-0qaecj3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:06Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=51ef8d74-823f-4db8-8212-4f2d20327524,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:23.393195 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:23.394501 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:33:23.394501 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.395051 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:23.395489 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:33:23.399070 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.399275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9e6f01a-e801-5a04-ae75-f49979c34bb5', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:23.400237 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.401171 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:23.402022 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.404383 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.404478 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0b47d9-63, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:23.405064 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0b47d9-63, col_values=(('qos', UUID('13747294-7783-43b4-b114-feb4292af84c')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:23.405064 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0b47d9-63, col_values=(('external_ids', {'iface-id': '0a0b47d9-6314-4f3f-85be-8b79cf058989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:57:38', 'vm-uuid': '51ef8d74-823f-4db8-8212-4f2d20327524'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:23.406201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.407485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:23.413402 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:23.414518 np0000000747 nova-compute[97971]: INFO os_vif [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63')
May 14 04:33:23.470636 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00044533699997373333 future=<Future at 0x74361822a6c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.470795 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.470920 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.27625814299995 future=<Future at 0x7435f840ac90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.471020 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.27615778599988516 future=<Future at 0x7435f840ac90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.471577 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Emitting event <LifecycleEvent: 1778733188.4700694, 78a47990-a6d1-4617-8c1c-538889b9f34a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:23.471921 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Stopped (Lifecycle Event)
May 14 04:33:23.721702 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733203.72127, dabbc5d1-d4bf-4184-8764-67d80388605d => ua-703750fc-3974-4b36-a16d-1d5b8ab367f7> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:33:23.723126 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-703750fc-3974-4b36-a16d-1d5b8ab367f7 for instance dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:33:23.726351 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Booting with volume 46977d6c-2c67-43ce-a101-9ed5481c354a at /dev/vda
May 14 04:33:23.729373 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully detached device vdb from instance dabbc5d1-d4bf-4184-8764-67d80388605d from the live domain config.
May 14 04:33:23.730961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:23.732782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:23.732782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:23.732782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:23.732782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '703750fc-3974-4b36-a16d-1d5b8ab367f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:23.733162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:23.747646 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004356829999778711 future=<Future at 0x7435f840ac90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.748100 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:23.750604 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Emitting event <LifecycleEvent: 1778733188.7470927, d38c474f-806e-4b2f-9a7f-4f25dda0ff88 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:23.752079 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] VM Stopped (Lifecycle Event)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:23.770674 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7 (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:23.771500 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976', '90')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:23.771500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '79')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:23.774077 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:23.775069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7', '80')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:23.776356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84bbba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'): ({'sdi'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:23.776907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:23.777192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flush multipath device 3300000009ef5ae9c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:23.791448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:23.814171 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:23.817318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:23.818846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:23.876566 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:23.886348 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f288f0f-a1ac-45a2-a6ad-19c7f6ed80e6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.723s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:23.889246 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:23.892029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:23.907594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:23.910637 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe10:873a', 'fe80::c05d:9bff:fec9:a897', 'fe80::fc16:3eff:fe05:ebaf', 'fe80::fc16:3eff:fedd:c426', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe6e:2b99', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f'] 
May 14 04:33:23.910637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:23.910637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:23.910637 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:23.910637 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating existing volume attachment record: 885e54ef-6e1b-4626-8184-128493ea3e1e {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:23.933332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:23.933534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:23.943925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:23.959315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:23.959782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:23.975600 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-9d2686c1-9e6d-49af-bfe2-71617fec90f2 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:23.977139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.016755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260]
May 14 04:33:24.016755 np0000000747 nova-compute[97971]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.40.100,3260] successful.
May 14 04:33:24.016755 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.041382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.061841 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.101462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260]
May 14 04:33:24.101462 np0000000747 nova-compute[97971]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-703750fc-3974-4b36-a16d-1d5b8ab367f7, portal: 192.168.50.100,3260] successful.
May 14 04:33:24.101462 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.117847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:24.118174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:24.118331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== disconnect_volume: return (386ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:24.118521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:24.234612 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:24.255764 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-826c6cff-04be-465e-9124-8a1eaf3502aa tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: d38c474f-806e-4b2f-9a7f-4f25dda0ff88] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:24.377601 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updated VIF entry in instance network info cache for port 05a7c243-fa8c-42a6-a886-aee31b18a80e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:24.377961 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [{"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:24.424585 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.424757 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance dabbc5d1-d4bf-4184-8764-67d80388605d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.424875 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 78a47990-a6d1-4617-8c1c-538889b9f34a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.425077 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.425182 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 687170c3-d447-4e92-a5cc-979a86a38cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.425284 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance c89476d9-d45d-46db-86c5-12165dc40a93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.425403 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 51ef8d74-823f-4db8-8212-4f2d20327524 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:33:24.425629 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:33:24.425820 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:33:23 up 33 min,  2 users,  load average: 9.71, 8.49, 4.78\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_cf8b3bba7862432eb957054a0284982b': '2', 'io_workload': '1', 'num_proj_6495e941aabb4280afd6c384a250e6dd': '1', 'num_task_rebuild_block_device_mapping': '1', 'num_proj_d8ca6721021640418a98b959a677f8a0': '1', 'num_proj_4b66752be38742a38c2a4ef876561d9a': '1', 'num_proj_9e1481ce79a54b72a2f83aa185ea46d1': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:33:24.689781 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:24.833863 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:24.834401 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:24.880956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45ec43a6-805a-4ecb-93a2-7397a88d6ceb req-07a112c9-9f62-444a-8b41-1ae93f3091cf service nova] Releasing lock "refresh_cache-dabbc5d1-d4bf-4184-8764-67d80388605d" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:24.950761 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:24.950886 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:24.950998 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:9c:57:38, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:24.951633 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Using config drive
May 14 04:33:25.337863 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:25.458947 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:25.654503 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Creating config drive at /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/disk.config
May 14 04:33:25.657908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1wlhkm1l {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:25.696846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5bcf6298-c733-4ccf-ae58-751df393eae5 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.129s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:25.716100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1wlhkm1l" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:25.848651 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:33:25.849224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.516s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:25.849736 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:26.046499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:33:26.047739 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating image(s)
May 14 04:33:26.048007 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:33:26.048314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Ensure instance console log exists: /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:33:26.048715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:26.049001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:26.050062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:26.050062 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start _get_guest_xml network_info=[{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T04:22:30Z,direct_url=<?>,disk_format='qcow2',id=c33366ff-2bc7-427b-a9a0-922bc7fdbf13,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T04:22:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '885e54ef-6e1b-4626-8184-128493ea3e1e', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '78a47990-a6d1-4617-8c1c-538889b9f34a', 'attached_at': '', 'detached_at': '', 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'serial': '46977d6c-2c67-43ce-a101-9ed5481c354a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:33:26.056178 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 14 04:33:26.057827 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='c33366ff-2bc7-427b-a9a0-922bc7fdbf13', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1976191561', uuid='78a47990-a6d1-4617-8c1c-538889b9f34a'), owner=OwnerMeta(userid='4e18a4a18a9c458b90e48fa022b5e13c', username='tempest-ServerActionsV293TestJSON-1284155576-project-member', projectid='d8ca6721021640418a98b959a677f8a0', projectname='tempest-ServerActionsV293TestJSON-1284155576'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733206.057207) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:33:26.060314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:33:26.060314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:33:26.062647 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:33:26.062647 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:33:26.062931 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:33:26.063514 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-14T04:22:30Z,direct_url=<?>,disk_format='qcow2',id=c33366ff-2bc7-427b-a9a0-922bc7fdbf13,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-14T04:22:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:33:26.066643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:33:26.068940 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:26.114969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.176870 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.231998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.235479 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.307530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.438308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1c7822fc-67da-43bd-8602-33b5f7077d3d req-f318f465-64fd-40c0-91bc-47b6314cf883 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:26.438308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1c7822fc-67da-43bd-8602-33b5f7077d3d req-f318f465-64fd-40c0-91bc-47b6314cf883 service nova] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:26.441247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1c7822fc-67da-43bd-8602-33b5f7077d3d req-f318f465-64fd-40c0-91bc-47b6314cf883 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:26.442003 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1c7822fc-67da-43bd-8602-33b5f7077d3d req-f318f465-64fd-40c0-91bc-47b6314cf883 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:26.442220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1c7822fc-67da-43bd-8602-33b5f7077d3d req-f318f465-64fd-40c0-91bc-47b6314cf883 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Processing event network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:26.552759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.554732 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.557577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.587496 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:26.593340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:26.594152 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:26.594152 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:26.594306 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:26.594549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:26.608477 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:26.609098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:26.609934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:26.610243 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:26.610916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:26.611103 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:26.624521 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:26.624521 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:26.629518 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:26.629518 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:26.640285 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a] added
May 14 04:33:26.640285 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:26.640285 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:26.640285 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:26.640285 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:26.640285 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:26.640285 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:26.640601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:26.640730 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:26.640922 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:26.644697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a] added
May 14 04:33:26.644697 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:26.644697 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:26.644697 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:26.644697 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:26.644697 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:26.644697 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:26.644997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:26.645036 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:26.645329 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:26.908644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:26.909024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:27.037384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:27.037384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:27.038664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:27.038664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:27.038664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:27.040246 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Terminating instance
May 14 04:33:27.120886 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733207.1205065, 51ef8d74-823f-4db8-8212-4f2d20327524 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:27.121070 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] VM Started (Lifecycle Event)
May 14 04:33:27.122154 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:27.126158 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:27.130047 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Instance spawned successfully.
May 14 04:33:27.130505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:33:27.415757 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Detaching volume a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d
May 14 04:33:27.488801 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Attempting to driver detach volume a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d from mountpoint /dev/vdb
May 14 04:33:27.493284 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found disk vdb by alias ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:27.494564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Found disk vdb by alias ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:27.494737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Attempting to detach device vdb from instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:33:27.494897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <alias name="ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d"/>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <serial>a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d</serial>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:27.494897 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:27.501043 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully detached device vdb from instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 from the persistent domain config.
May 14 04:33:27.501242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] (1/8): Attempting to detach device vdb with device alias ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d from instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:33:27.501505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <alias name="ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d"/>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-5"/>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <serial>a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d</serial>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:27.501505 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:27.545900 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:27.568859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.571868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.594466 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.598902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.620154 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.623302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:27.626746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.630038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:27.638666 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.638666 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.638952 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.639078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.639278 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.639525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:27.642978 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:27.647901 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:27.657291 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:27.657291 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:27.670721 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:27.670721 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.680348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.688187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.696994 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:27.708350 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.708350 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.708350 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.708350 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.708350 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.708350 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:27.708697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.708697 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.708697 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.708697 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.708697 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.708697 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:27.745515 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:27.745786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:27.745990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:27.746154 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:27.746306 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:27.746976 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-20fd4ce6-1345-498b-ad73-83503ba61881 req-d671894b-ad2d-4081-afb1-1b5db17fd0a5 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:27.748982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260]
May 14 04:33:27.748982 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260] successful.
May 14 04:33:27.748982 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.758247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260]
May 14 04:33:27.758247 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260] successful.
May 14 04:33:27.758247 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.765624 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.773168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.786705 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] HCTL ('9', '-', '-', 0) found on session 91 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:27.786705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.796080 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:27.796356 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:27.796659 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:27.796729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:27.797861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:27.797930 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:27.806013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching for a device in session 91 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:27.806407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:27.816588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:27.816588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:27.849243 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:27.850024 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:33:27.850247 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:33:27.850779 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.76 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:33:27.875205 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.884581 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:27.920751 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Instance destroyed successfully.
May 14 04:33:27.920751 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'resources' on Instance uuid dabbc5d1-d4bf-4184-8764-67d80388605d {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:28.112675 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d for instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:33:28.134883 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:33:28.135294 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733208.1350255, 51ef8d74-823f-4db8-8212-4f2d20327524 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:28.135491 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] VM Paused (Lifecycle Event)
May 14 04:33:28.145299 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Took 19.62 seconds to spawn the instance on the hypervisor.
May 14 04:33:28.145528 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:28.407096 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.424835 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1098880331',display_name='tempest-TestMinimumBasicScenario-server-1098880331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-1098880331',id=39,image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFtOPxfwx9xTLSJiXDgMIZQat6J862l8/hhM5gzDqOQIKE38RfyxyMrTpTeY8PmMvscBme//qNjnfRpXOImd2Db2aIS4oh1keYr13BuUE+UrOONnpPv1fips54CWzRMw==',key_name='tempest-TestMinimumBasicScenario-1693061427',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-yo5q4ujm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ec2043d3-3da6-418e-aacb-e796c7c4ff10',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:42Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=dabbc5d1-d4bf-4184-8764-67d80388605d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:28.425073 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "address": "fa:16:3e:dd:c4:26", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a7c243-fa", "ovs_interfaceid": "05a7c243-fa8c-42a6-a886-aee31b18a80e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:28.425852 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:28.426131 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:28.427689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.427923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a7c243-fa, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:28.428821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.429868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:28.430156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.430926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.431092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff14d2ac-e947-4e07-b045-854d97989a34) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:28.431552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.432146 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:28.432479 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:28.434200 np0000000747 nova-compute[97971]: INFO os_vif [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c4:26,bridge_name='br-int',has_traffic_filtering=True,id=05a7c243-fa8c-42a6-a886-aee31b18a80e,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a7c243-fa')
May 14 04:33:28.434470 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Deleting instance files /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d_del
May 14 04:33:28.435426 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Deletion of /opt/stack/data/nova/instances/dabbc5d1-d4bf-4184-8764-67d80388605d_del complete
May 14 04:33:28.533433 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:28.533667 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:28.533878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:28.534004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:28.534134 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] No waiting events found dispatching network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:28.534272 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8b5158f6-2010-4ee2-aec0-540905329bfa req-e2f7a2d3-1c6b-491f-b990-9ff288725f7c service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received unexpected event network-vif-plugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 for instance with vm_state active and task_state None.
May 14 04:33:28.612554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:33:28.639004 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:28.647839 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733208.6474414, 51ef8d74-823f-4db8-8212-4f2d20327524 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:28.647995 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] VM Resumed (Lifecycle Event)
May 14 04:33:28.658495 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Took 27.11 seconds to build instance.
May 14 04:33:28.941762 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:33:28.942326 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:33:28.942598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:33:28.942797 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:33:28.943190 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:29.070072 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:29.154424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:29.156529 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:29.165969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.626s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:29.632247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Found WWN 330000000f525beb2 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:33:29.632518 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:29.632710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000f525beb2', 'path': '/dev/dm-1', 'multipath_id': '330000000f525beb2'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:29.632858 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f525beb2', 'path': '/dev/dm-1', 'multipath_id': '330000000f525beb2'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:33:29.659342 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999640859999772 future=<Future at 0x74361826e210 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:29.659581 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999352851999674 future=<Future at 0x74361826e210 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:29.659696 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999223771999596 future=<Future at 0x74361826e210 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:29.659916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733209.6597376, 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 => ua-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:33:29.663072 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully detached device vdb from instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 from the live domain config.
May 14 04:33:29.664858 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:29.665167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:29.665333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:29.665745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:29.666088 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:29.666263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:29.694997 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:29.695333 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:29.695333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '92')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:29.695751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '89')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:29.696533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d', '88')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:29.697593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f827a700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:29.697757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:29.697975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Flush multipath device 330000000cc5b34a7 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:29.731955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:29.780525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:29.828467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:29.829142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] Acquiring lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] No waiting events found dispatching network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:29.831627 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6444cc7f-a4cc-4a73-b8fd-33b84ed4468e req-bc266751-cb7b-4286-b6a3-caa6a3381fc4 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-unplugged-05a7c243-fa8c-42a6-a886-aee31b18a80e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:29.833763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:29.848245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:29.848495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:29.860669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.884219 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:29.885564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:29.885790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:29.887364 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:29.889379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:29.889652 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:29.893002 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.40.100,3260]
May 14 04:33:29.893002 np0000000747 nova-compute[97971]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.40.100,3260] successful.
May 14 04:33:29.893002 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.894293 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Terminating instance
May 14 04:33:29.911514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.923068 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.955590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.50.100,3260]
May 14 04:33:29.955590 np0000000747 nova-compute[97971]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-a9e6cccb-cebe-424c-98f1-c1df8cfe4a0d, portal: 192.168.50.100,3260] successful.
May 14 04:33:29.955590 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.971139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:29.971324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:29.971487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] <== disconnect_volume: return (305ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:29.971733 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:30.139817 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1976191561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:26Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:33:30.140072 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:30.140599 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:30.142056 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <uuid>78a47990-a6d1-4617-8c1c-538889b9f34a</uuid>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <name>instance-00000029</name>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1976191561</nova:name>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:33:26</nova:creationTime>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:image uuid="c33366ff-2bc7-427b-a9a0-922bc7fdbf13">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:user uuid="4e18a4a18a9c458b90e48fa022b5e13c">tempest-ServerActionsV293TestJSON-1284155576-project-member</nova:user>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:project uuid="d8ca6721021640418a98b959a677f8a0">tempest-ServerActionsV293TestJSON-1284155576</nova:project>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid="c33366ff-2bc7-427b-a9a0-922bc7fdbf13"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         <nova:port uuid="7a85c8c7-f3d6-4104-8047-287669c598a5">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <system>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="serial">78a47990-a6d1-4617-8c1c-538889b9f34a</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="uuid">78a47990-a6d1-4617-8c1c-538889b9f34a</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </system>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <os>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </os>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <features>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </features>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   <devices>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <alias name="ua-46977d6c-2c67-43ce-a101-9ed5481c354a"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <serial>46977d6c-2c67-43ce-a101-9ed5481c354a</serial>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1e:dc:b3"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <target dev="tap7a85c8c7-f3"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </interface>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/console.log" append="off"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </serial>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <video>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </video>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </rng>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:   </devices>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]: </domain>
May 14 04:33:30.142056 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:33:30.143964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1976191561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:26Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:33:30.143964 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:30.144328 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:30.144564 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:33:30.144843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.145067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:30.145268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:33:30.145943 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.146114 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '682f5646-128c-5186-a84c-b598bc22febd', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:30.147111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.147825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:30.149801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.151466 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.151713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a85c8c7-f3, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:30.152130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a85c8c7-f3, col_values=(('qos', UUID('13079a0a-3d9b-49fb-9b84-5697d7f31831')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:30.152358 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a85c8c7-f3, col_values=(('external_ids', {'iface-id': '7a85c8c7-f3d6-4104-8047-287669c598a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:dc:b3', 'vm-uuid': '78a47990-a6d1-4617-8c1c-538889b9f34a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:30.153451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.155055 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:30.162071 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.163243 np0000000747 nova-compute[97971]: INFO os_vif [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3')
May 14 04:33:30.399967 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Took 1.46 seconds to deallocate network for instance.
May 14 04:33:30.401672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:30.440910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.442846 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.466910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.468469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.502551 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:30.543306 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'flavor' on Instance uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:30.674390 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7413932-52ec-477c-bb73-cce755252118 req-be5ffe69-8f80-4375-a33f-ad74f0955d18 service nova] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Received event network-vif-deleted-05a7c243-fa8c-42a6-a886-aee31b18a80e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:30.765042 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999663671999997 future=<Future at 0x7435f821b2c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:30.768190 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Instance destroyed successfully.
May 14 04:33:30.768550 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 51ef8d74-823f-4db8-8212-4f2d20327524 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:30.913867 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:30.913987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:31.115279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.271965 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1854009623',display_name='tempest-TestVolumeBootPattern-server-1854009623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1854009623',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:33:28Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-0qaecj3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:33:28Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=51ef8d74-823f-4db8-8212-4f2d20327524,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:31.272203 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "address": "fa:16:3e:9c:57:38", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0b47d9-63", "ovs_interfaceid": "0a0b47d9-6314-4f3f-85be-8b79cf058989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:31.272882 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:31.273158 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:31.275415 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.275696 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0b47d9-63, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:31.277042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.278108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:31.292514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.295192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.295473 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13747294-7783-43b4-b114-feb4292af84c) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:31.296540 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.297139 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:31.303854 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:31.307356 np0000000747 nova-compute[97971]: INFO os_vif [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:38,bridge_name='br-int',has_traffic_filtering=True,id=0a0b47d9-6314-4f3f-85be-8b79cf058989,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0b47d9-63')
May 14 04:33:31.342789 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '51ef8d74-823f-4db8-8212-4f2d20327524', 'attached_at': '', 'detached_at': '', 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'serial': '4fe8750e-120f-4ef2-af98-a077d620f9f2'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:33:31.343414 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:33:31.343637 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:33:31.343828 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:33:31.344523 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7435f8409340>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '51ef8d74-823f-4db8-8212-4f2d20327524', 'attached_at': '', 'detached_at': '', 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'serial': '4fe8750e-120f-4ef2-af98-a077d620f9f2'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:33:31.345097 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] closing encrypted volume /dev/dm-6 {{(pid=97971) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 14 04:33:31.373367 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:31.373775 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:31.373995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:31.374414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:31.374792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4fe8750e-120f-4ef2-af98-a077d620f9f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:31.374956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:31.376979 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:31.377228 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:31.405060 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:31.405060 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:31.405060 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:31.405060 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:31.405060 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:31.405060 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:31.405439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:31.405439 np0000000747 nova-compute[97971]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2 (non-flash)
May 14 04:33:31.405439 np0000000747 nova-compute[97971]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976 (non-flash)
May 14 04:33:31.405439 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:31.405439 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:31.405439 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:31.405727 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a388f987-4739-4638-8c53-1b7c9e3ab976', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '92')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:31.405727 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '84')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:31.409131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2', '85')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:31.410079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436183b19e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:31.410298 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:31.410572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 330000000e461d300 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:31.438965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:31.475289 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:31.514986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:31.515187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:31.516881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:31.527717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:31.527896 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:31.543979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.561510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-950215e6-fe04-48ac-8eca-cbdbbc57d918 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.652s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:31.578462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.40.100,3260]
May 14 04:33:31.578462 np0000000747 nova-compute[97971]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.40.100,3260] successful.
May 14 04:33:31.578462 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.599554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.614888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.644025 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.50.100,3260]
May 14 04:33:31.644025 np0000000747 nova-compute[97971]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-4fe8750e-120f-4ef2-af98-a077d620f9f2, portal: 192.168.50.100,3260] successful.
May 14 04:33:31.644025 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.664039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:31.665358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:31.665538 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (291ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:31.665700 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:31.666002 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Deleting instance files /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524_del
May 14 04:33:31.666718 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Deletion of /opt/stack/data/nova/instances/51ef8d74-823f-4db8-8212-4f2d20327524_del complete
May 14 04:33:31.701406 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:31.701801 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:31.701983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] No VIF found with MAC fa:16:3e:1e:dc:b3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:31.702490 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Using config drive
May 14 04:33:31.880219 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:32.180173 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Took 1.78 seconds to destroy the instance on the hypervisor.
May 14 04:33:32.181431 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:33:32.181766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:33:32.181979 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:33:32.182458 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:32.206894 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lazy-loading 'ec2_ids' on Instance uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:32.268106 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:32.389202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.474s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:32.457500 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Deleted allocations for instance dabbc5d1-d4bf-4184-8764-67d80388605d
May 14 04:33:32.647426 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2e34a3cb-d729-4884-9e11-bad8474ef492 req-40ff32a8-8633-47dc-9846-1dd72c034384 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-deleted-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:32.647818 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-2e34a3cb-d729-4884-9e11-bad8474ef492 req-40ff32a8-8633-47dc-9846-1dd72c034384 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Neutron deleted interface 0a0b47d9-6314-4f3f-85be-8b79cf058989; detaching it from the instance and deleting it from the info cache
May 14 04:33:32.647936 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2e34a3cb-d729-4884-9e11-bad8474ef492 req-40ff32a8-8633-47dc-9846-1dd72c034384 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:32.671808 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:32.671968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:32.672153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:32.672298 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:32.672472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:32.676443 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Terminating instance
May 14 04:33:32.710714 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Object Instance<78a47990-a6d1-4617-8c1c-538889b9f34a> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:33:32.710959 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lazy-loading 'keypairs' on Instance uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] No waiting events found dispatching network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Acquiring lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Lock "51ef8d74-823f-4db8-8212-4f2d20327524-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] No waiting events found dispatching network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Received event network-vif-unplugged-0a0b47d9-6314-4f3f-85be-8b79cf058989 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:32.757831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing instance network info cache due to event network-changed-f18f39e9-7273-4df6-8a76-5ed50786263c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:32.759025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Acquiring lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:32.759272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Acquired lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:32.762343 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Refreshing network info cache for port f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:33.100261 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:33.152917 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2e34a3cb-d729-4884-9e11-bad8474ef492 req-40ff32a8-8633-47dc-9846-1dd72c034384 service nova] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Detach interface failed, port_id=0a0b47d9-6314-4f3f-85be-8b79cf058989, reason: Instance 51ef8d74-823f-4db8-8212-4f2d20327524 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:33:33.182002 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:33.211742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.217530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.217530 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Object Instance<78a47990-a6d1-4617-8c1c-538889b9f34a> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:33:33.221883 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 14 04:33:33.243953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.265267 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:33.398280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.410037 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.435855 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Creating config drive at /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config
May 14 04:33:33.440795 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj9gvs5_c {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:33.476739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-be5f56ff-1e6e-4a5c-a1d3-1db7738db1c0 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "dabbc5d1-d4bf-4184-8764-67d80388605d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.439s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:33.508647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.525989 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:33.526745 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj9gvs5_c" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:33.533959 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999619942000209 future=<Future at 0x7436183dc200 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:33.545336 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Instance destroyed successfully.
May 14 04:33:33.546736 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'resources' on Instance uuid 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:33.603474 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Took 1.42 seconds to deallocate network for instance.
May 14 04:33:33.783439 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:33.997696 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updated VIF entry in instance network info cache for port f18f39e9-7273-4df6-8a76-5ed50786263c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:33.998070 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [{"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:34.013531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.052441 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.055037 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.056551 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1356233134',display_name='tempest-TestStampPattern-server-1356233134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1356233134',id=42,image_ref='9fdd3734-0958-481c-b580-e5038ff3011e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:30Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-pcmsqe4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5c037683-9726-4c1e-b4eb-d41e0155d9fa',image_min_disk='1',image_min_ram='0',image_owner_id='cf8b3bba7862432eb957054a0284982b',image_owner_project_name='tempest-TestStampPattern-1110078540',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1110078540-project-member',image_user_id='c70081f7fcd749669ada222e6be6e8a1',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:31Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=3b3f3c21-1103-4b9c-8a06-9ab0d95826e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:34.056780 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "f18f39e9-7273-4df6-8a76-5ed50786263c", "address": "fa:16:3e:05:eb:af", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18f39e9-72", "ovs_interfaceid": "f18f39e9-7273-4df6-8a76-5ed50786263c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:34.057595 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:34.058062 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:34.062920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.063136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18f39e9-72, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:34.064598 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.065754 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:34.066816 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.068339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.068434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bee94edf-49a3-43e7-8fe3-891f6d5a32a4) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:34.069828 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.070344 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:34.075320 np0000000747 nova-compute[97971]: INFO os_vif [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:eb:af,bridge_name='br-int',has_traffic_filtering=True,id=f18f39e9-7273-4df6-8a76-5ed50786263c,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18f39e9-72')
May 14 04:33:34.075720 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Deleting instance files /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8_del
May 14 04:33:34.076861 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Deletion of /opt/stack/data/nova/instances/3b3f3c21-1103-4b9c-8a06-9ab0d95826e8_del complete
May 14 04:33:34.161498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.197100 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Took 0.59 seconds to detach 1 volumes for instance.
May 14 04:33:34.345045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.436079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:34.436304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:34.436519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:34.436676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:34.436798 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:34.436920 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-3ade1a26-69f6-455e-a376-f4447aed9606 req-ad8711e3-1ade-4cc9-8cac-89201bd2a2ed service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received unexpected event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with vm_state active and task_state rebuild_spawning.
May 14 04:33:34.448034 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.450045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.461356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.481472 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:34.501207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30b64760-8c21-4af1-8794-b3ba434723ad req-b8e024cb-9089-4758-bd42-abf351860594 service nova] Releasing lock "refresh_cache-3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:34.590153 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:33:34.591142 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:33:34.591439 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:33:34.591550 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:33:34.591758 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:34.688932 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:34.705906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:34.706384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:34.845332 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:34.845526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:34.845750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:34.845918 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:34.846472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] No waiting events found dispatching network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:34.846472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:34.846472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:34.846472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Acquiring lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:34.846811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:34.846811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:34.846987 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] No waiting events found dispatching network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:34.847065 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61d679f1-e93e-40a8-991c-0a079e4a514d req-4ba45348-39d4-454b-9e54-fb387ff1ca07 service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-unplugged-f18f39e9-7273-4df6-8a76-5ed50786263c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:35.112146 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:35.113193 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:35.115317 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733215.1125097, 78a47990-a6d1-4617-8c1c-538889b9f34a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:35.115317 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Resumed (Lifecycle Event)
May 14 04:33:35.119722 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance spawned successfully.
May 14 04:33:35.119805 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:33:35.124196 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eac1a6c1-c8df-4da1-b118-cb0e8cc29ed2 req-332d1550-d7f9-47b6-b7ee-b55613c322cd service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Received event network-vif-deleted-f18f39e9-7273-4df6-8a76-5ed50786263c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:35.129551 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-eac1a6c1-c8df-4da1-b118-cb0e8cc29ed2 req-332d1550-d7f9-47b6-b7ee-b55613c322cd service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Neutron deleted interface f18f39e9-7273-4df6-8a76-5ed50786263c; detaching it from the instance and deleting it from the info cache
May 14 04:33:35.129877 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-eac1a6c1-c8df-4da1-b118-cb0e8cc29ed2 req-332d1550-d7f9-47b6-b7ee-b55613c322cd service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:35.149271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:35.150888 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:35.216357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:35.560550 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:35.617975 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:35.621863 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:35.630497 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.630668 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.631077 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.631322 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.632194 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.632194 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:35.639906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eac1a6c1-c8df-4da1-b118-cb0e8cc29ed2 req-332d1550-d7f9-47b6-b7ee-b55613c322cd service nova] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Detach interface failed, port_id=f18f39e9-7273-4df6-8a76-5ed50786263c, reason: Instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:33:35.652945 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:36.059074 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Took 1.47 seconds to deallocate network for instance.
May 14 04:33:36.118769 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:36.129547 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 14 04:33:36.129829 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733216.1295633, 78a47990-a6d1-4617-8c1c-538889b9f34a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:36.130024 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Started (Lifecycle Event)
May 14 04:33:36.140233 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:36.166884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.460s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:36.243939 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 51ef8d74-823f-4db8-8212-4f2d20327524
May 14 04:33:36.534608 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:36.534895 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:36.535142 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:36.535321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:36.535570 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:36.535716 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-329d0a95-e0b0-4f0b-a34c-61a5230d2f7c req-54c3accf-7ac2-429c-849c-0a628705b8cb service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received unexpected event network-vif-plugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with vm_state active and task_state None.
May 14 04:33:36.565923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:36.568036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:36.638332 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:36.645588 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:36.655333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:36.934797 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:36.934971 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:37.261648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b63c383b-608e-4d2e-a3a6-5504026ca919 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "51ef8d74-823f-4db8-8212-4f2d20327524" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.376s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:37.437641 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:37.878835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:37.944221 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.378s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:37.946287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.289s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:37.946709 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=97971) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 14 04:33:38.033351 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Deleted allocations for instance 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8
May 14 04:33:38.282709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:38.283331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:38.785330 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:33:38.960865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-556db790-64fc-417b-9a18-9e5cf9ceb6ca tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.016s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:39.044576 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2e9e8475-de19-4481-92f3-2e1c491e8bc5 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "3b3f3c21-1103-4b9c-8a06-9ab0d95826e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.372s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:39.069804 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:39.366716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:39.367394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:39.373805 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:33:39.374802 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Claim successful on node np0000000747
May 14 04:33:39.656834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:39.657235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:39.657444 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Shelving
May 14 04:33:40.704777 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:40.712598 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:40.733652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:40.739592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:40.773471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:40.829701 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:40.829968 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:40.954675 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:40.956889 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:40.957101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:40.957278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:40.957955 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:40.957955 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-197c9516-db24-4361-af29-8ef7c447e6cd req-fdef2497-2900-4235-b87f-f98abf9819de service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received unexpected event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with vm_state active and task_state shelving.
May 14 04:33:41.030498 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999728805000359 future=<Future at 0x7435f84306e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:41.033164 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance destroyed successfully.
May 14 04:33:41.033861 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'numa_topology' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:41.120005 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:41.337098 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:41.634471 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Beginning cold snapshot process
May 14 04:33:41.845498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.478s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:41.845975 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:33:42.352672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:33:42.353944 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:33:42.354272 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:42.354578 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:42.468331 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5673930adce14c6ea2b647e1a339636b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6495e941aabb4280afd6c384a250e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:33:42.662166 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:42.663297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:42.855009 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:33:43.053690 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received unexpected event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with vm_state active and task_state shelving_image_pending_upload.
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing instance network info cache due to event network-changed-3cfc2bdd-ad33-47f0-9950-128e706633e2. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Acquiring lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Acquired lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:43.056641 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Refreshing network info cache for port 3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:43.070900 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Successfully created port: bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:33:43.146873 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:33:43.149632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk /opt/stack/data/nova/instances/snapshots/tmp1hj4f8zp/7573a418e92745108551e143882198f8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:43.181767 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:43.250639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:43.250639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:43.250639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:43.250639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:43.250639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:43.251744 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Terminating instance
May 14 04:33:43.362598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:33:43.417818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:43.418056 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:43.438538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk /opt/stack/data/nova/instances/snapshots/tmp1hj4f8zp/7573a418e92745108551e143882198f8" returned: 0 in 0.291s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:43.438842 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Snapshot extracted, beginning image upload
May 14 04:33:43.559165 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:43.606020 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Successfully updated port: bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:33:43.756624 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:43.784723 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:43.811104 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:43.839471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:43.862030 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:43.924873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:33:44.036362 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updated VIF entry in instance network info cache for port 3cfc2bdd-ad33-47f0-9950-128e706633e2. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:44.036753 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating instance_info_cache with network_info: [{"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:44.074981 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.102923 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999693899000249 future=<Future at 0x7435f85c5d60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:44.106851 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Instance destroyed successfully.
May 14 04:33:44.107258 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lazy-loading 'resources' on Instance uuid 5c037683-9726-4c1e-b4eb-d41e0155d9fa {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:44.108837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:44.108972 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:44.109121 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:33:44.192504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.530s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:44.379553 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:33:44.380702 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:33:44.380898 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Creating image(s)
May 14 04:33:44.381381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:44.381572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:44.382168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:44.385646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:44.385646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:44.526339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:44.527349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:44.531794 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:33:44.531794 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Claim successful on node np0000000747
May 14 04:33:44.542282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-342d5ddf-9e46-4429-88d5-1b7140aa8a2c req-1a336a9c-5856-4d31-bca3-78f088744341 service nova] Releasing lock "refresh_cache-5c037683-9726-4c1e-b4eb-d41e0155d9fa" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:44.615269 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:30:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1477337880',display_name='tempest-TestStampPattern-server-1477337880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-teststamppattern-server-1477337880',id=35,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ4+WuCF4xe2CeMXJd1ysdGRDxcI6wD4xIOcSDfUTlV0Q0+AQGqoXYyvuzK9IEwK/6WKyd6GFmSDs0VD3kJcRMOHEYmstjZ0Vq+uC0Q+uP16VRcrXY7e7aDSvszdHJ1nw==',key_name='tempest-TestStampPattern-1328207055',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:31:05Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf8b3bba7862432eb957054a0284982b',ramdisk_id='',reservation_id='r-8a07gwn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1110078540',owner_user_name='tempest-TestStampPattern-1110078540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:32:15Z,user_data=None,user_id='c70081f7fcd749669ada222e6be6e8a1',uuid=5c037683-9726-4c1e-b4eb-d41e0155d9fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:44.615768 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converting VIF {"id": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "address": "fa:16:3e:10:87:3a", "network": {"id": "90ca5168-bdf7-46ba-9900-98e24cebafc5", "bridge": "br-int", "label": "tempest-TestStampPattern-319712745-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf8b3bba7862432eb957054a0284982b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cfc2bdd-ad", "ovs_interfaceid": "3cfc2bdd-ad33-47f0-9950-128e706633e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:44.616408 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:44.616819 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:44.626328 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.629834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cfc2bdd-ad, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:44.633227 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:44.638317 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.642796 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.642939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=882e7959-d62e-42de-9e7b-b3d512bc361f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:44.645237 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.645237 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:44.652359 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:44.655383 np0000000747 nova-compute[97971]: INFO os_vif [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:87:3a,bridge_name='br-int',has_traffic_filtering=True,id=3cfc2bdd-ad33-47f0-9950-128e706633e2,network=Network(90ca5168-bdf7-46ba-9900-98e24cebafc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cfc2bdd-ad')
May 14 04:33:44.655768 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Deleting instance files /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa_del
May 14 04:33:44.656513 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Deletion of /opt/stack/data/nova/instances/5c037683-9726-4c1e-b4eb-d41e0155d9fa_del complete
May 14 04:33:44.661997 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0030454990001089755 future=<Future at 0x74361826e210 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:44.662384 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:44.662511 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.1021455690001858 future=<Future at 0x7435f821b2c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:44.663485 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=1.1020433379999304 future=<Future at 0x7435f821b2c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:44.663485 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] Emitting event <LifecycleEvent: 1778733209.6588585, dabbc5d1-d4bf-4184-8764-67d80388605d => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:44.663485 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] VM Stopped (Lifecycle Event)
May 14 04:33:44.709037 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:33:44.901635 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:44.968143 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:44.968382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:45.056361 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:45.117162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:45.118799 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing instance network info cache due to event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:45.118799 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:45.132900 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.137890 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.137890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.171472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2f33397d-113b-4dce-a74d-178e8ca40ade tempest-ServerBootFromVolumeStableRescueTest-589525365 tempest-ServerBootFromVolumeStableRescueTest-589525365-project-member] [instance: dabbc5d1-d4bf-4184-8764-67d80388605d] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:45.182162 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Took 1.43 seconds to destroy the instance on the hypervisor.
May 14 04:33:45.183285 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:33:45.183768 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:33:45.184008 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:33:45.184800 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:45.257499 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.part --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.258064 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] d3f41b31-48f4-42f0-ac45-2bf97acd4dbe was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:33:45.258752 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:33:45.259102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.part /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.289249 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:45.289625 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:45.291449 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Attaching volume 0cb063c4-429f-4e94-9a95-34ad1911343a to /dev/vdb
May 14 04:33:45.303136 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:45.304200 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:45.304463 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:45.304463 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:45.304632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:45.304776 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f80c8ce8-b785-4bb8-b251-84d3cc9969c6 req-aa674630-eab3-4fc1-9c12-259e1922d5e3 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state building and task_state spawning.
May 14 04:33:45.326195 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:45.364584 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:45.380847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:45.408154 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.458452 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:45.459575 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:45.467922 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.part /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.converted" returned: 0 in 0.209s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.471036 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:33:45.478142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:45.482463 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627'] 
May 14 04:33:45.482668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:45.482830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:45.483145 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:45.484774 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating existing volume attachment record: 9174dfe6-650f-4ed3-8fab-46f63da016ff {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:45.487581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.558289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:45.558961 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance network_info: |[{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:33:45.559456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:45.559653 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:45.628474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.629700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.246s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:45.630156 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.634241 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.635723 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.747692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.748240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:45.748739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:45.749254 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.753907 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:45.754434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.780426 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.011946952000016609 future=<Future at 0x7435f821b2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:45.780671 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:45.782877 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.750646391000373 future=<Future at 0x7436183dc200 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:45.783018 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.750467507000394 future=<Future at 0x7436183dc200 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:45.786396 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Emitting event <LifecycleEvent: 1778733210.7645833, 51ef8d74-823f-4db8-8212-4f2d20327524 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:45.789983 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] VM Stopped (Lifecycle Event)
May 14 04:33:45.855798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.856410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e,backing_fmt=raw /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:45.958563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e,backing_fmt=raw /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk 1073741824" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:45.959796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:45.960212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:46.065444 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:46.079038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cdb36beb7df6ea4a4ea8122f9e355aa4650c14e --force-share --output=json" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:46.081084 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:33:46.081637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:46.110729 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:46.112165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:46.112763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:46.127126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.014s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:46.127700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:46.130081 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.136711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:46.151811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:46.151811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:46.151811 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:46.152455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:46.157479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:46.157479 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:46.176358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:46.176358 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:46.179360 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:46.189515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a] added
May 14 04:33:46.189515 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:46.189515 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:46.189515 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:46.189515 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:46.189515 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:46.189515 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:46.190697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:46.190697 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:46.191299 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:46.197725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:46.197725 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:46.200475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:46.200475 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Cannot resize image /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:33:46.201282 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:33:46.202994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Ensure instance console log exists: /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:33:46.203241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:46.208791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:46.208974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:46.211378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Start _get_guest_xml network_info=[{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:33:35Z,direct_url=<?>,disk_format='qcow2',id=d3f41b31-48f4-42f0-ac45-2bf97acd4dbe,min_disk=0,min_ram=0,name='tempest-scenario-img--25663719',owner='6495e941aabb4280afd6c384a250e6dd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:33:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': 'd3f41b31-48f4-42f0-ac45-2bf97acd4dbe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:33:46.214522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a] added
May 14 04:33:46.214522 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:46.214522 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:46.214522 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:46.214522 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:46.214522 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:46.214522 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:46.214873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:46.215391 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.058(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:46.215951 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:46.218841 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:33:46.220716 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-964923410', uuid='eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0'), owner=OwnerMeta(userid='5673930adce14c6ea2b647e1a339636b', username='tempest-TestMinimumBasicScenario-482942579-project-member', projectid='6495e941aabb4280afd6c384a250e6dd', projectname='tempest-TestMinimumBasicScenario-482942579'), image=ImageMeta(id='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733226.2200992) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:33:46.223835 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:33:46.223982 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:33:46.236167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:33:46.236603 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:33:35Z,direct_url=<?>,disk_format='qcow2',id=d3f41b31-48f4-42f0-ac45-2bf97acd4dbe,min_disk=0,min_ram=0,name='tempest-scenario-img--25663719',owner='6495e941aabb4280afd6c384a250e6dd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:33:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:33:46.243260 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:33:46.258220 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-964923410',display_name='tempest-TestMinimumBasicScenario-server-964923410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-964923410',id=47,image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2Gw3kDzWhR6/v107eHSiG0XsjebHh9kctWgdIkta8daqNXdTbW1KnDMtXDbXFHEhlFznvXJQnkCUpWjmQ1num5gKvnT7h/a+fyIYz3/tanWMHS0IoMSkrrU9DgVf/PPg==',key_name='tempest-TestMinimumBasicScenario-72143506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-30m4y50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:43Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:33:46.258702 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:46.259319 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:46.260436 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'pci_devices' on Instance uuid eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:46.261687 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:46.261916 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:46.299128 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c5fda020-3e6a-4cf9-a4d1-67d0293b0ef6 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] [instance: 51ef8d74-823f-4db8-8212-4f2d20327524] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:46.389781 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Snapshot image upload complete
May 14 04:33:46.390027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:46.461139 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:46.581344 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updated VIF entry in instance network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:46.581698 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:46.699014 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Took 1.51 seconds to deallocate network for instance.
May 14 04:33:46.764599 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:46.770356 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] End _get_guest_xml xml=<domain type="qemu">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <uuid>eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0</uuid>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <name>instance-0000002f</name>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestMinimumBasicScenario-server-964923410</nova:name>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:33:46</nova:creationTime>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:image uuid="d3f41b31-48f4-42f0-ac45-2bf97acd4dbe">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:user uuid="5673930adce14c6ea2b647e1a339636b">tempest-TestMinimumBasicScenario-482942579-project-member</nova:user>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:project uuid="6495e941aabb4280afd6c384a250e6dd">tempest-TestMinimumBasicScenario-482942579</nova:project>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="d3f41b31-48f4-42f0-ac45-2bf97acd4dbe"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         <nova:port uuid="bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <system>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="serial">eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="uuid">eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </system>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <os>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </os>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <features>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </features>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   <devices>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.config"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:eb:dd:74"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <target dev="tapbc0c2b58-ea"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </interface>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/console.log" append="off"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </serial>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <video>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </video>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </rng>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:   </devices>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]: </domain>
May 14 04:33:46.770356 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Preparing to wait for external event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-964923410',display_name='tempest-TestMinimumBasicScenario-server-964923410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-964923410',id=47,image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2Gw3kDzWhR6/v107eHSiG0XsjebHh9kctWgdIkta8daqNXdTbW1KnDMtXDbXFHEhlFznvXJQnkCUpWjmQ1num5gKvnT7h/a+fyIYz3/tanWMHS0IoMSkrrU9DgVf/PPg==',key_name='tempest-TestMinimumBasicScenario-72143506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-30m4y50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:43Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:46.773157 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:46.773566 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:33:46.773946 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.774040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:46.774453 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:33:46.775351 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.775583 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '583b91dd-7144-59e2-ac49-841e09e9194f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:46.776275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.776949 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:46.782151 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.784749 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.784988 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc0c2b58-ea, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:46.786197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc0c2b58-ea, col_values=(('qos', UUID('c4e0854d-1e1d-4feb-9af3-1559aedcfe3b')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:46.786776 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc0c2b58-ea, col_values=(('external_ids', {'iface-id': 'bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:dd:74', 'vm-uuid': 'eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:46.787753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.788826 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:46.799248 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:46.800247 np0000000747 nova-compute[97971]: INFO os_vif [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea')
May 14 04:33:46.899747 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Shelve offloading
May 14 04:33:47.083820 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ddc9697-b5fb-4fe1-8263-15e815c16e47 req-68d027fc-5f19-4a09-8a03-028691e0769d service nova] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:47.182507 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f263ddc-3d6e-401f-a5a0-1334ef4e3b12 req-15abedb0-a3fc-4d22-ac3d-e5e9a8d65c1f service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-vif-deleted-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:47.197904 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:47.209202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:47.211596 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:47.211596 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.216489 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:47.226866 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:47.233807 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:47.233807 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.241323 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:47.249144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.276725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.749s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:47.277207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.146s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:47.277911 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:33:47.282161 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:33:47.284960 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Claim successful on node np0000000747
May 14 04:33:47.287967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.287967 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.287967 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.287967 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.287967 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:47.289018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.40.100,3260]
May 14 04:33:47.289018 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.40.100,3260] successful.
May 14 04:33:47.289018 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.289233 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.289233 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.289233 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.289233 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.289233 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:47.302791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.322397 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:47.323222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:47.323222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:47.326580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('8', '-', '-', 0) found on session 94 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:47.326580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:47.331962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.50.100,3260]
May 14 04:33:47.331962 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.50.100,3260] successful.
May 14 04:33:47.331962 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.348398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:47.360680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 94 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:47.360853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:47.368354 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.368354 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.368354 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.368354 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.368354 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.368354 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:47.368680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.368680 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:47.368680 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:47.368680 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.368680 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:47.368680 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:47.368791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:47.369099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:47.369580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('11', '-', '-', 0) found on session 95 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:47.371229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:47.377192 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:47.377677 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:47.377854 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:47.377971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:47.378091 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] No waiting events found dispatching network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:47.378215 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received unexpected event network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 for instance with vm_state deleted and task_state None.
May 14 04:33:47.378316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received event network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:47.381366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Acquiring lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:47.381366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:47.381366 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:47.381366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] No waiting events found dispatching network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:47.381366 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6d73432f-f518-4ecc-a1ac-3faf93bf257e req-78251879-46f7-431e-8bbc-d07920eae712 service nova] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Received unexpected event network-vif-unplugged-3cfc2bdd-ad33-47f0-9950-128e706633e2 for instance with vm_state deleted and task_state None.
May 14 04:33:47.388933 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 95 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:47.388933 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:47.405840 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance destroyed successfully.
May 14 04:33:47.406389 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:47.409682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:47.409831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:47.409977 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:33:47.801779 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:33:47.802049 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:33:47.802206 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:47.802438 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:47.876718 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:33:47.914685 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:48.157646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:33:48.302158 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:48.304888 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:33:48.328635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:48.328779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:48.332353 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No VIF found with MAC fa:16:3e:eb:dd:74, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:48.332353 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Using config drive
May 14 04:33:48.335085 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Successfully created port: 5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:33:48.506635 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:48.534634 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0010509179996915918 future=<Future at 0x7436183dc200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:48.535685 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Emitting event <LifecycleEvent: 1778733213.5334098, 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:48.536140 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:48.536140 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] VM Stopped (Lifecycle Event)
May 14 04:33:48.537766 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.492439770000146 future=<Future at 0x7435f84306e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:48.537940 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.4922352990001855 future=<Future at 0x7435f84306e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:48.773635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:48.773885 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:48.819728 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:33:48.841004 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:48.939845 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Successfully updated port: 5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:33:49.005544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-changed-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:49.005728 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Refreshing instance network info cache due to event network-changed-5639f92a-8488-484a-a627-ab2b7a900da1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:49.005983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] Acquiring lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:49.006084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] Acquired lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:49.006167 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Refreshing network info cache for port 5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:49.009927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:49.009927 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:49.010234 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:49.032733 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Creating config drive at /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.config
May 14 04:33:49.035882 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoh5wo0zl {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:49.054030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: 3b3f3c21-1103-4b9c-8a06-9ab0d95826e8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:49.095863 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoh5wo0zl" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:49.176987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found WWN 33000000020220658 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:33:49.177778 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:49.178023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== connect_volume: return (3065ms) {'type': 'block', 'scsi_wwn': '33000000020220658', 'path': '/dev/dm-0', 'multipath_id': '33000000020220658'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:49.178386 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000020220658', 'path': '/dev/dm-0', 'multipath_id': '33000000020220658'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:33:49.184031 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:49.278711 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:49.327418 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Booting with volume 8f022989-b0e9-46ab-82b5-b05c89434667 at /dev/vda
May 14 04:33:49.411317 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:49.424091 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:49.443396 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:49.455649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:49.501315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:49.502636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:49.510101 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:49.526945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:49.527174 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627'] 
May 14 04:33:49.527174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:49.527388 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:49.527573 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:49.527845 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating existing volume attachment record: 7a6eb3d4-44b8-4192-be5c-65ba385d4e69 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:49.600949 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.603105 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance destroyed successfully.
May 14 04:33:49.606072 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'resources' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:49.610929 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:33:49.635679 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.641187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.692464 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Attempting to attach volume 0cb063c4-429f-4e94-9a95-34ad1911343a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:33:49.695280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:   <alias name="ua-0cb063c4-429f-4e94-9a95-34ad1911343a"/>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:   <serial>0cb063c4-429f-4e94-9a95-34ad1911343a</serial>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:49.695280 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:33:49.726327 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.791270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.514s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:49.791902 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:33:49.794833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.586s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:49.818572 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:49.906868 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de72ff97-d376-4513-ac8d-b03635779285 req-724a8003-023a-44d3-b7a5-7d37c330807a service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:49.912855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de72ff97-d376-4513-ac8d-b03635779285 req-724a8003-023a-44d3-b7a5-7d37c330807a service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:49.913157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de72ff97-d376-4513-ac8d-b03635779285 req-724a8003-023a-44d3-b7a5-7d37c330807a service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:49.915713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de72ff97-d376-4513-ac8d-b03635779285 req-724a8003-023a-44d3-b7a5-7d37c330807a service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:49.916425 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de72ff97-d376-4513-ac8d-b03635779285 req-724a8003-023a-44d3-b7a5-7d37c330807a service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Processing event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:49.961917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.968191 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.973357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:49.999829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.002099 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.108537 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:33:50.109930 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtb9QV4XvuBfnA05emM57/WcWso8r5NPfBec5Tu1J8nYM7V3/ara2n6gEVXGlEjV8TqoijahoZLcyalP/n57ysp6rDOYfUeS2g5hOuOvgVqsXsosTTJa9jm3ccNaIxcOQ==',key_name='tempest-keypair-2120776940',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:58Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:33:46.389836',shelved_host='np0000000747',shelved_image_id='4041593a-959f-4414-a75a-eb45497b3ff3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:33:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:50.109930 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:50.110548 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:50.110880 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:50.112395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.112762 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea09587-45, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:50.114805 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.116579 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:50.117690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.117774 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7214ffb-cac9-43ec-a29c-a4a686734769) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:50.118524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:50.121156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:50.125233 np0000000747 nova-compute[97971]: INFO os_vif [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45')
May 14 04:33:50.125561 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Deleting instance files /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1_del
May 14 04:33:50.130380 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Deletion of /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1_del complete
May 14 04:33:50.285402 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:50.285857 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:50.302712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:33:50.302864 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:33:50.303127 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:50.303323 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:50.321003 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-099f9f29-3562-4f5f-87e7-f8e338dd8b9f req-2e3479e9-665c-456e-8824-f48ff4c8515d service nova] Releasing lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:50.321003 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:50.321199 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:33:50.406486 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d9dc4d2831e4439bc7a9e419dbfa358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865fbadd3db24c0a95a089a1b63e6cf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:33:50.639462 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733230.6388812, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:50.640384 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:50.640733 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Started (Lifecycle Event)
May 14 04:33:50.645094 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:50.647253 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance spawned successfully.
May 14 04:33:50.647635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:33:50.710877 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Deleted allocations for instance 687170c3-d447-4e92-a5cc-979a86a38cd1
May 14 04:33:50.789753 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:50.806782 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:33:50.933340 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:33:50.984537 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Successfully created port: 598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:33:51.091633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:51.091825 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing instance network info cache due to event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:51.092044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:51.097635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:51.097635 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:51.124387 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:51.145216 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:51.150406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:51.161914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.162385 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.162827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.163128 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.163462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.163778 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:51.170345 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:51.218404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:51.298974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.504s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:51.302510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.084s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:51.310985 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:33:51.351976 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating instance_info_cache with network_info: [{"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:51.390967 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Deleted allocations for instance 5c037683-9726-4c1e-b4eb-d41e0155d9fa
May 14 04:33:51.425806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:51.425952 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:51.426119 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:51.426301 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:aa:e8:e0, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:51.599923 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:51.608540 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Successfully updated port: 598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:33:51.657641 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:33:51.657641 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733231.6551056, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:51.657641 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Paused (Lifecycle Event)
May 14 04:33:51.679009 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:33:51.682823 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Took 7.30 seconds to spawn the instance on the hypervisor.
May 14 04:33:51.682919 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:51.687692 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:33:51.688126 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Creating image(s)
May 14 04:33:51.688568 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:33:51.689099 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Ensure instance console log exists: /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:33:51.689099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:51.689099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:51.689228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:51.716099 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:51.716315 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:51.856890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:51.857234 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance network_info: |[{"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:33:51.858334 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Start _get_guest_xml network_info=[{"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7a6eb3d4-44b8-4192-be5c-65ba385d4e69', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f2d96b98-baae-4f6a-96ef-39960a67461e', 'attached_at': '', 'detached_at': '', 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'serial': '8f022989-b0e9-46ab-82b5-b05c89434667'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:33:51.861339 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:33:51.862520 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1822614431', uuid='f2d96b98-baae-4f6a-96ef-39960a67461e'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733231.8621495) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:33:51.864037 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:33:51.864281 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:33:51.866505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:33:51.866806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:33:51.867989 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:33:51.867989 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:33:51.868233 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:33:51.868330 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:33:51.868434 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:33:51.868562 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:33:51.868695 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:33:51.868855 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:33:51.868977 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:33:51.869088 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:33:51.869184 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:33:51.869284 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:33:51.881067 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:51.881335 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:51.881525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:51.881901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:51.882100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:51.903761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:51.904519 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:51.905548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:51.905842 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:51.906833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:51.907111 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:51.921539 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:51.921539 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:51.931348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:51.931348 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:51.944774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667] added
May 14 04:33:51.944774 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:51.944774 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:51.944774 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:51.944774 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:51.944774 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:51.944774 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:51.945071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:51.945223 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:51.945340 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667] added
May 14 04:33:51.947763 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:51.947763 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:51.947763 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:51.970270 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:51.971001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:51.971168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:51.971301 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:51.971450 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:51.971659 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-c00d9f47-f059-4265-bfdd-756feda228bf req-49c15928-cac4-44b9-b4c7-a8fe9b35235b service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state active and task_state None.
May 14 04:33:52.015185 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:52.113826 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:52.113921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquired lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:52.114069 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:33:52.164706 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:52.166158 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733232.1656365, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:52.166158 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Resumed (Lifecycle Event)
May 14 04:33:52.176339 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updated VIF entry in instance network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:52.176798 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5ea09587-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:52.203183 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Took 12.91 seconds to build instance.
May 14 04:33:52.220255 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:33:52.322447 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:33:52.323585 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:33:52.323863 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Creating image(s)
May 14 04:33:52.324372 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:52.324589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:52.325119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.325821 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:52.329519 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:52.330624 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:52.405189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3b5b9485-681f-42f7-8164-004f77194f42 tempest-TestStampPattern-1110078540 tempest-TestStampPattern-1110078540-project-member] Lock "5c037683-9726-4c1e-b4eb-d41e0155d9fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.157s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.443401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:52.444020 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:52.444466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:52.445001 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:52.453518 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:33:52.454344 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:52.582243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.128s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:52.582775 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:52.651236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk 1073741824" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:52.652179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.652457 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:52.673282 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:52.682301 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a1cba582-e634-4574-99d5-c22e34d67e94 req-0a591bff-9bae-485d-8a81-29c778789775 service nova] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:52.689719 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:52.705300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.422s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.731525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.429s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.741050 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:33:52.771724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:52.771724 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:33:52.771724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:52.891403 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:52.894036 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Cannot resize image /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:33:52.894526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:33:52.894778 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:33:52.895092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:52.895290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:52.895445 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:52.946115 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:52.946767 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:52.959010 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:52.966431 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:52.966431 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:52.971750 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:52.971750 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:52.981270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:52.987165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:52.999988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:52.999988 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:52.999988 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:52.999988 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:52.999988 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:52.999988 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:53.000221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.000221 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.000221 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.000221 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.000221 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.000221 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:53.001428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.001428 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.001428 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.001428 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.001428 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.001428 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:53.001604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.001604 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.001604 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.001604 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.001604 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.001604 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:53.045556 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.40.100,3260]
May 14 04:33:53.045556 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.40.100,3260] successful.
May 14 04:33:53.045556 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:53.047327 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c9cd07f4-c925-4f49-8830-03b6b4056c87 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.758s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:53.048568 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.50.100,3260]
May 14 04:33:53.048568 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.50.100,3260] successful.
May 14 04:33:53.048568 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:53.059112 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:53.069300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.082797 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.083160 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:53.083950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:53.084218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.085210 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-237e7578-d178-49aa-a4ed-d078d24802ba (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:53.085459 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:53.086252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:53.087340 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:53.088317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('13', '-', '-', 0) found on session 97 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:53.088494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:53.089016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('12', '-', '-', 0) found on session 96 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:53.089016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:53.124633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 97 and hctl ['13', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:53.124633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:53.124633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 96 and hctl ['12', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:53.124633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:53.139087 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating instance_info_cache with network_info: [{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:53.184074 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-changed-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:53.184237 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Refreshing instance network info cache due to event network-changed-598ecf1f-7796-4592-ad4f-9b8dbfaf1323. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:33:53.184421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] Acquiring lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:33:53.256908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18e06b0c-e84c-45d1-82d0-cee90f25ee7f tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.600s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:53.643550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Releasing lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:53.643550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Instance network_info: |[{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:33:53.643550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] Acquired lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:33:53.643550 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Refreshing network info cache for port 598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:33:53.645071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Start _get_guest_xml network_info=[{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:33:53.648855 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:33:53.650057 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1910509060', uuid='d6c04f76-1f81-4921-ab27-3ff5b59b43b9'), owner=OwnerMeta(userid='6d9dc4d2831e4439bc7a9e419dbfa358', username='tempest-VolumesExtendAttachedTest-676713984-project-member', projectid='865fbadd3db24c0a95a089a1b63e6cf3', projectname='tempest-VolumesExtendAttachedTest-676713984'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733233.6497085) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:33:53.651092 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:33:53.651536 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:33:53.652258 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:33:53.652384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:33:53.653183 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:33:53.653570 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:33:53.653684 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:33:53.654259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:33:53.654679 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:33:53.654679 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:33:53.654732 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:33:53.672100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1910509060',display_name='tempest-VolumesExtendAttachedTest-instance-1910509060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesextendattachedtest-instance-1910509060',id=49,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWTy2VtA84PPnVinojO4bZuhZtayLde2ad4kiLwNqNHZMWn0rJnR5AuV7/T87S/l6R2b6IflVR4Pvw6hZ6waPiXlafkTsxvNJCNcyk/Piwdg4lStozOcOY7pfduyH0/Lw==',key_name='tempest-keypair-1538462261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='865fbadd3db24c0a95a089a1b63e6cf3',ramdisk_id='',reservation_id='r-tubqv3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-676713984',owner_user_name='tempest-VolumesExtendAttachedTest-676713984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d9dc4d2831e4439bc7a9e419dbfa358',uuid=d6c04f76-1f81-4921-ab27-3ff5b59b43b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:33:53.672478 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converting VIF {"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:53.673635 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:53.674321 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lazy-loading 'pci_devices' on Instance uuid d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:53.907715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:33:53.936443 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:53.936642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:53.936791 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Unshelving
May 14 04:33:54.146068 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:54.177151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] End _get_guest_xml xml=<domain type="qemu">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <uuid>d6c04f76-1f81-4921-ab27-3ff5b59b43b9</uuid>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <name>instance-00000031</name>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1910509060</nova:name>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:33:53</nova:creationTime>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:user uuid="6d9dc4d2831e4439bc7a9e419dbfa358">tempest-VolumesExtendAttachedTest-676713984-project-member</nova:user>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:project uuid="865fbadd3db24c0a95a089a1b63e6cf3">tempest-VolumesExtendAttachedTest-676713984</nova:project>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         <nova:port uuid="598ecf1f-7796-4592-ad4f-9b8dbfaf1323">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <system>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="serial">d6c04f76-1f81-4921-ab27-3ff5b59b43b9</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="uuid">d6c04f76-1f81-4921-ab27-3ff5b59b43b9</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </system>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <os>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </os>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <features>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </features>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   <devices>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.config"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:2f:82:73"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <target dev="tap598ecf1f-77"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </interface>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/console.log" append="off"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </serial>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <video>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </video>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </rng>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:   </devices>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]: </domain>
May 14 04:33:54.177151 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Preparing to wait for external event network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1910509060',display_name='tempest-VolumesExtendAttachedTest-instance-1910509060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesextendattachedtest-instance-1910509060',id=49,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWTy2VtA84PPnVinojO4bZuhZtayLde2ad4kiLwNqNHZMWn0rJnR5AuV7/T87S/l6R2b6IflVR4Pvw6hZ6waPiXlafkTsxvNJCNcyk/Piwdg4lStozOcOY7pfduyH0/Lw==',key_name='tempest-keypair-1538462261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='865fbadd3db24c0a95a089a1b63e6cf3',ramdisk_id='',reservation_id='r-tubqv3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-676713984',owner_user_name='tempest-VolumesExtendAttachedTest-676713984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d9dc4d2831e4439bc7a9e419dbfa358',uuid=d6c04f76-1f81-4921-ab27-3ff5b59b43b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converting VIF {"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:54.179988 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:54.184037 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:33:54.185493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.185493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:54.185493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:33:54.186186 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.186454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc0e8dc4-547a-5a53-923c-1c42324d2921', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:54.193025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.194107 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:54.194649 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.199420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.199420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598ecf1f-77, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:54.199420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap598ecf1f-77, col_values=(('qos', UUID('35b59387-b4d9-4d19-9157-0c149ce4db84')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:54.199420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap598ecf1f-77, col_values=(('external_ids', {'iface-id': '598ecf1f-7796-4592-ad4f-9b8dbfaf1323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:82:73', 'vm-uuid': 'd6c04f76-1f81-4921-ab27-3ff5b59b43b9'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:54.200489 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.201803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:54.208151 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:54.208735 np0000000747 nova-compute[97971]: INFO os_vif [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77')
May 14 04:33:54.356772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:54.356991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:54.486736 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:54.551513 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:54.552065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:54.645949 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updated VIF entry in instance network info cache for port 598ecf1f-7796-4592-ad4f-9b8dbfaf1323. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:33:54.646329 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating instance_info_cache with network_info: [{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:33:54.865190 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Detaching volume 0cb063c4-429f-4e94-9a95-34ad1911343a
May 14 04:33:54.916014 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Attempting to driver detach volume 0cb063c4-429f-4e94-9a95-34ad1911343a from mountpoint /dev/vdb
May 14 04:33:54.918812 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-0cb063c4-429f-4e94-9a95-34ad1911343a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:54.920484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-0cb063c4-429f-4e94-9a95-34ad1911343a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:33:54.921088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Attempting to detach device vdb from instance c89476d9-d45d-46db-86c5-12165dc40a93 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:33:54.921624 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <alias name="ua-0cb063c4-429f-4e94-9a95-34ad1911343a"/>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <serial>0cb063c4-429f-4e94-9a95-34ad1911343a</serial>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:54.921624 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:54.928856 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance c89476d9-d45d-46db-86c5-12165dc40a93 from the persistent domain config.
May 14 04:33:54.929098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] (1/8): Attempting to detach device vdb with device alias ua-0cb063c4-429f-4e94-9a95-34ad1911343a from instance c89476d9-d45d-46db-86c5-12165dc40a93 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:33:54.929939 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <alias name="ua-0cb063c4-429f-4e94-9a95-34ad1911343a"/>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <serial>0cb063c4-429f-4e94-9a95-34ad1911343a</serial>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]: </disk>
May 14 04:33:54.929939 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:33:54.932747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 33000000099207f86 for multipath device dm-4 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:33:54.933198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:54.933477 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000099207f86', 'path': '/dev/dm-4', 'multipath_id': '33000000099207f86'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:54.933686 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099207f86', 'path': '/dev/dm-4', 'multipath_id': '33000000099207f86'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:33:55.055275 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:55.148782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-069311f1-1767-4b9b-bc3c-5543dfe7141b req-c3b83bf0-5cd4-4f3e-930b-20ffe7317a97 service nova] Releasing lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:33:55.366159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.443305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822614431',display_name='tempest-TestVolumeBootPattern-server-1822614431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1822614431',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM325XYBnrm0g4jbxRwUCN2TSGnobJ57LNXfUwZwj+cCVfF3i9OswYXn0bbcVt/+OiCw769GkVQTbUwqf4Ffld/5hvdp+UiCyHHsN6tNECqNkMIzbWoDvwH5CI1OMH9DKQ==',key_name='tempest-keypair-95157993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-ybdgw1cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=f2d96b98-baae-4f6a-96ef-39960a67461e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:33:55.443593 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:55.443990 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:55.444497 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid f2d96b98-baae-4f6a-96ef-39960a67461e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:55.450195 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Booting with volume 94557006-4383-444b-9f3a-93dc68b3266e at /dev/vdc
May 14 04:33:55.490333 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733235.489485, c89476d9-d45d-46db-86c5-12165dc40a93 => ua-0cb063c4-429f-4e94-9a95-34ad1911343a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:33:55.491473 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0cb063c4-429f-4e94-9a95-34ad1911343a for instance c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:33:55.493967 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance c89476d9-d45d-46db-86c5-12165dc40a93 from the live domain config.
May 14 04:33:55.495488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:33:55.496816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:55.496816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:55.496816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:55.496816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cb063c4-429f-4e94-9a95-34ad1911343a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:33:55.497124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:33:55.511762 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:55.525000 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:55.525385 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:55.525385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '97')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:33:55.525705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', '94')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:55.526967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a', '95')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:33:55.527885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f832be20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:33:55.528289 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:55.528700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Removing multipathed devices sdc, sdf {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:33:55.528989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flush multipath device 33000000020220658 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:33:55.557858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:55.603173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:55.622835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:55.623365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:55.633907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:55.635032 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627', 'fe80::fc16:3eff:feeb:dd74', 'fe80::f880:e3ff:fe10:cad'] 
May 14 04:33:55.635187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:55.635303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:55.635590 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:55.635804 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating existing volume attachment record: 68a93f94-da8d-4038-aacf-28ce221e7e73 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:55.657367 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:33:55.704139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if SCSI volumes sdc, sdf have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:33:55.704316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] SCSI volumes sdc, sdf have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:33:55.706203 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if device paths {'sdc', 'sdf'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:33:55.719818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Device paths {'sdc', 'sdf'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:33:55.720132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:33:55.735440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:55.735440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.735440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:55.735720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No VIF found with MAC fa:16:3e:2f:82:73, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:55.736408 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Using config drive
May 14 04:33:55.768183 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.40.100,3260]
May 14 04:33:55.768183 np0000000747 nova-compute[97971]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.40.100,3260] successful.
May 14 04:33:55.768183 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.785730 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.797873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.830967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.50.100,3260]
May 14 04:33:55.830967 np0000000747 nova-compute[97971]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-0cb063c4-429f-4e94-9a95-34ad1911343a, portal: 192.168.50.100,3260] successful.
May 14 04:33:55.830967 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.845345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:55.845763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:55.845932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== disconnect_volume: return (350ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:55.846092 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <uuid>f2d96b98-baae-4f6a-96ef-39960a67461e</uuid>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <name>instance-00000030</name>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1822614431</nova:name>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:33:51</nova:creationTime>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         <nova:port uuid="5639f92a-8488-484a-a627-ab2b7a900da1">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <system>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="serial">f2d96b98-baae-4f6a-96ef-39960a67461e</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="uuid">f2d96b98-baae-4f6a-96ef-39960a67461e</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </system>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <os>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </os>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <features>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </features>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   <devices>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/disk.config"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <alias name="ua-8f022989-b0e9-46ab-82b5-b05c89434667"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-4"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <serial>8f022989-b0e9-46ab-82b5-b05c89434667</serial>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </disk>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e7:2f:04"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <target dev="tap5639f92a-84"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </interface>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/console.log" append="off"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </serial>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <video>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </video>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </rng>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:   </devices>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: </domain>
May 14 04:33:55.951703 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Preparing to wait for external event network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:55.951703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822614431',display_name='tempest-TestVolumeBootPattern-server-1822614431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1822614431',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM325XYBnrm0g4jbxRwUCN2TSGnobJ57LNXfUwZwj+cCVfF3i9OswYXn0bbcVt/+OiCw769GkVQTbUwqf4Ffld/5hvdp+UiCyHHsN6tNECqNkMIzbWoDvwH5CI1OMH9DKQ==',key_name='tempest-keypair-95157993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-ybdgw1cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=f2d96b98-baae-4f6a-96ef-39960a67461e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:55.956176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:33:55.957719 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.958493 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a90c4cc1-a391-52c4-91db-905b9851b864', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:55.960475 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.961481 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:55.968917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.972908 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.974345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5639f92a-84, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:55.974345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5639f92a-84, col_values=(('qos', UUID('4288ab0c-5816-4f1e-8e70-a6ce8dca462f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:55.974345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5639f92a-84, col_values=(('external_ids', {'iface-id': '5639f92a-8488-484a-a627-ab2b7a900da1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:2f:04', 'vm-uuid': 'f2d96b98-baae-4f6a-96ef-39960a67461e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:55.974776 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.976513 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:55.985882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:55.986173 np0000000747 nova-compute[97971]: INFO os_vif [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84')
May 14 04:33:56.030840 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005698790000678855 future=<Future at 0x7435f84306e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:56.031215 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Emitting event <LifecycleEvent: 1778733221.0301092, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:56.031365 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:56.031570 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Stopped (Lifecycle Event)
May 14 04:33:56.031695 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.07086517200014 future=<Future at 0x7435f85c5d60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:56.031798 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.070755878 future=<Future at 0x7435f85c5d60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:56.104782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.553s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:56.127252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:56.244464 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:56.388779 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Creating config drive at /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.config
May 14 04:33:56.393140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ylcm7oz {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:56.410561 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:56.461499 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ylcm7oz" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:56.536796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:56.986171 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.030992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.157233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.161531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:57.161743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:57.162084 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Attaching volume a55bcb53-6677-467e-a440-3bd44265590e to /dev/vdb
May 14 04:33:57.234362 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:57.255028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:33:57.286805 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:57.347416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:33:57.348168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:33:57.362286 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:57.364040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:57.364040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:33:57.365508 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feaa:e8e0', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:fe1e:dcb3', 'fe80::608f:46ff:fe63:b627', 'fe80::fc16:3eff:feeb:dd74', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe2f:8273', 'fe80::34ee:b8ff:fe2d:5ba6'] 
May 14 04:33:57.365745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:33:57.365911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:33:57.366222 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:33:57.369226 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating existing volume attachment record: 3861020a-016c-4d27-b361-ad9787bd65d4 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:33:57.375162 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_requests' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:57.391160 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cf4ee6e2-f032-44e6-960b-1b6176124e6d req-814fd41d-052f-45bb-a26b-51ad3ab983d9 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:57.391450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf4ee6e2-f032-44e6-960b-1b6176124e6d req-814fd41d-052f-45bb-a26b-51ad3ab983d9 service nova] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:57.391656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf4ee6e2-f032-44e6-960b-1b6176124e6d req-814fd41d-052f-45bb-a26b-51ad3ab983d9 service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:57.391883 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cf4ee6e2-f032-44e6-960b-1b6176124e6d req-814fd41d-052f-45bb-a26b-51ad3ab983d9 service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:57.391999 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cf4ee6e2-f032-44e6-960b-1b6176124e6d req-814fd41d-052f-45bb-a26b-51ad3ab983d9 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Processing event network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:57.419934 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-79bba5c1-aa08-48be-b715-173d67c49e7b tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.063s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:57.446769 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.455336 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.490626 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.494676 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:57.517088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:57.517195 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:33:57.517325 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:e7:2f:04, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:33:57.517804 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Using config drive
May 14 04:33:57.729018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:57.729901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:57.730185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:57.730537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:57.730582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:57.736611 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Terminating instance
May 14 04:33:57.879425 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'numa_topology' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:57.955536 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:33:57.955882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:33:57.955998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:57.956327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:57.956539 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:33:57.972185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:57.973250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:33:57.973768 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:57.973998 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:57.974566 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:33:57.974801 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:57.989112 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733237.9871204, d6c04f76-1f81-4921-ab27-3ff5b59b43b9 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:57.989112 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] VM Started (Lifecycle Event)
May 14 04:33:57.989112 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:57.994336 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:57.994987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:57.994987 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:57.998562 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Instance spawned successfully.
May 14 04:33:58.000101 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:33:58.002643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:33:58.002643 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:58.012647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e] added
May 14 04:33:58.012647 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:58.012647 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:58.012647 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:58.012647 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:58.012647 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:58.012647 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:58.013004 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:58.013160 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:58.013667 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:58.017497 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e] added
May 14 04:33:58.017497 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:33:58.017497 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:58.017497 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:58.017497 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:33:58.017497 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:33:58.017497 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:58.017721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:33:58.017808 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:33:58.017969 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:33:58.024963 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:33:58.163354 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Creating config drive at /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/disk.config
May 14 04:33:58.167886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7f0wyvz9 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:33:58.241726 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:33:58.243541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7f0wyvz9" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:33:58.383254 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:33:58.383254 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Claim successful on node np0000000747
May 14 04:33:58.389278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.398066 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.410983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.422845 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.456978 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.457471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.491976 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:58.502887 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:33:58.519088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.519315 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.519852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.520399 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.520705 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.524739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:33:58.658332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.671911 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.945080 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.952300 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Instance destroyed successfully.
May 14 04:33:58.952300 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'resources' on Instance uuid c89476d9-d45d-46db-86c5-12165dc40a93 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:33:58.989365 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:58.991200 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.007035 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:33:59.007343 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733239.0070934, d6c04f76-1f81-4921-ab27-3ff5b59b43b9 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:59.008883 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] VM Paused (Lifecycle Event)
May 14 04:33:59.015656 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:33:59.020761 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:33:59.032884 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Took 6.71 seconds to spawn the instance on the hypervisor.
May 14 04:33:59.032884 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:59.048949 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:59.048949 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:33:59.052295 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:33:59.052295 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.066005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.079949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.081208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.085942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.085942 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.085942 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.085942 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.085942 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:59.087775 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.087775 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.087775 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.087775 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.087775 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:59.103638 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005180180000934342 future=<Future at 0x7435f85c5d60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:59.103638 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:33:59.106259 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733224.1024897, 5c037683-9726-4c1e-b4eb-d41e0155d9fa => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:59.106400 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] VM Stopped (Lifecycle Event)
May 14 04:33:59.116247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.116247 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.116247 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.116247 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.116247 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:59.116961 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.116961 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.116961 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.116961 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.116961 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:59.152239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.50.100,3260]
May 14 04:33:59.152239 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.50.100,3260] successful.
May 14 04:33:59.152239 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.168658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.182732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.40.100,3260]
May 14 04:33:59.182732 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.40.100,3260] successful.
May 14 04:33:59.182732 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.190385 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.190774 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:59.190975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:59.191152 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:59.192557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('7', '-', '-', 0) found on session 98 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:59.192557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:59.195973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.217461 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:33:59.218264 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.244s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:33:59.218264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:33:59.219303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] HCTL ('8', '-', '-', 0) found on session 99 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:33:59.219303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:33:59.223219 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 98 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:59.223534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:59.249661 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Searching for a device in session 99 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:33:59.249881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:33:59.429753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.438286 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.443740 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.456972 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-361255871',display_name='tempest-AttachVolumeNegativeTest-server-361255871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-361255871',id=45,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChQCa4Gz8Vzk2YZy9I5NKj8FGgD53Kvc02Y5rsdJkj1OFTq7LWlOTvCwKbm8t4QVgIF+IyV172gJSQ1OjYkpA+kYefj22vvHEwYc/EiKTRK4kzybdxLeu5eEloZ6szgXg==',key_name='tempest-keypair-791235995',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:33:03Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-n80tx1pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:33:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=c89476d9-d45d-46db-86c5-12165dc40a93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:33:59.457535 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "c3e32337-e309-4b1c-817c-e6eb0af52770", "address": "fa:16:3e:aa:e8:e0", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e32337-e3", "ovs_interfaceid": "c3e32337-e309-4b1c-817c-e6eb0af52770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:33:59.458646 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:33:59.459128 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:33:59.462258 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.462672 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3e32337-e3, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:59.465384 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.466492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:59.482997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.485729 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.502940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.504685 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5ef024a-41dd-473c-b3bb-36100d1424b9) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:33:59.505295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:33:59.506279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:33:59.513392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:59.514044 np0000000747 nova-compute[97971]: INFO os_vif [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:e8:e0,bridge_name='br-int',has_traffic_filtering=True,id=c3e32337-e309-4b1c-817c-e6eb0af52770,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e32337-e3')
May 14 04:33:59.514443 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Deleting instance files /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93_del
May 14 04:33:59.515354 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Deletion of /opt/stack/data/nova/instances/c89476d9-d45d-46db-86c5-12165dc40a93_del complete
May 14 04:33:59.526297 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:59.526482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:59.526944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:59.527842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:59.528016 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] No waiting events found dispatching network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:59.528201 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received unexpected event network-vif-plugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 for instance with vm_state active and task_state None.
May 14 04:33:59.528370 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:59.528537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:59.528740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:59.529070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:59.529171 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] No waiting events found dispatching network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:59.529316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:59.529462 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:59.529580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Acquiring lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:59.529770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:59.529882 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "c89476d9-d45d-46db-86c5-12165dc40a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:59.529985 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] No waiting events found dispatching network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:33:59.530103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-unplugged-c3e32337-e309-4b1c-817c-e6eb0af52770 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:33:59.530198 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:33:59.530339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:33:59.530475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:33:59.530601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:33:59.530735 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fcf35299-c204-4f22-bf33-c50eb4cb73a8 req-8d2229df-8e97-43d7-b7cf-3aa1a6f7a555 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Processing event network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:33:59.531308 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733239.5309198, d6c04f76-1f81-4921-ab27-3ff5b59b43b9 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:33:59.531875 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] VM Resumed (Lifecycle Event)
May 14 04:33:59.557267 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Took 13.56 seconds to build instance.
May 14 04:33:59.614461 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 5c037683-9726-4c1e-b4eb-d41e0155d9fa] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:33:59.836951 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:33:59.837269 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:33:59.975446 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:33:59.976511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:33:59.978827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:33:59.980644 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance spawned successfully.
May 14 04:33:59.980962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:34:00.026444 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Took 1.78 seconds to destroy the instance on the hypervisor.
May 14 04:34:00.027699 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:34:00.028061 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:34:00.028186 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:34:00.028462 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:00.037963 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:00.041696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:00.058960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd237eb1-96a9-44b7-99b0-bf81d4ae67f0 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.091s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:00.093279 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:00.342711 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:00.492918 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.493093 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.494137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.494137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.494137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.494441 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:00.545547 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999667549999685 future=<Future at 0x7435f8456270 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:00.546875 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998103443999753 future=<Future at 0x7435f8456270 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:00.546875 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997851783999977 future=<Future at 0x7435f8456270 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:00.548672 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733240.5472715, f2d96b98-baae-4f6a-96ef-39960a67461e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:00.550355 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] VM Started (Lifecycle Event)
May 14 04:34:00.633390 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68a2fa1b-f533-4d06-984e-23faf9f0b651 req-21a6d953-44b4-46af-a205-7c2ba64c35de service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Received event network-vif-deleted-c3e32337-e309-4b1c-817c-e6eb0af52770 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:00.633692 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-68a2fa1b-f533-4d06-984e-23faf9f0b651 req-21a6d953-44b4-46af-a205-7c2ba64c35de service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Neutron deleted interface c3e32337-e309-4b1c-817c-e6eb0af52770; detaching it from the instance and deleting it from the info cache
May 14 04:34:00.633754 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-68a2fa1b-f533-4d06-984e-23faf9f0b651 req-21a6d953-44b4-46af-a205-7c2ba64c35de service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:00.855795 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.493s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:00.856098 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:00.939930 np0000000747 nova-compute[97971]: INFO nova.network.neutron [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 with attributes {'binding:host_id': 'np0000000747', 'device_owner': 'compute:nova'}
May 14 04:34:00.997243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found WWN 33000000016e0422b for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:34:00.997577 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:00.997814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '33000000016e0422b', 'path': '/dev/dm-0', 'multipath_id': '33000000016e0422b'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:00.997978 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000016e0422b', 'path': '/dev/dm-0', 'multipath_id': '33000000016e0422b'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:34:01.000204 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Took 9.32 seconds to spawn the instance on the hypervisor.
May 14 04:34:01.000383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:01.005899 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:01.044314 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:01.057450 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:01.062812 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:01.127238 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:01.152872 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-68a2fa1b-f533-4d06-984e-23faf9f0b651 req-21a6d953-44b4-46af-a205-7c2ba64c35de service nova] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Detach interface failed, port_id=c3e32337-e309-4b1c-817c-e6eb0af52770, reason: Instance c89476d9-d45d-46db-86c5-12165dc40a93 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:34:01.406776 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-changed-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:01.407301 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Refreshing instance network info cache due to event network-changed-598ecf1f-7796-4592-ad4f-9b8dbfaf1323. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:01.407588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] Acquiring lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:01.407760 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] Acquired lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:01.407946 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Refreshing network info cache for port 598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:01.518125 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Attempting to attach volume a55bcb53-6677-467e-a440-3bd44265590e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:34:01.522392 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:   <alias name="ua-a55bcb53-6677-467e-a440-3bd44265590e"/>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:   <serial>a55bcb53-6677-467e-a440-3bd44265590e</serial>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:01.522392 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:34:01.522876 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Took 17.08 seconds to build instance.
May 14 04:34:01.549187 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Took 1.52 seconds to deallocate network for instance.
May 14 04:34:01.568155 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:34:01.568457 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733241.5682364, f2d96b98-baae-4f6a-96ef-39960a67461e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:01.569028 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] VM Paused (Lifecycle Event)
May 14 04:34:01.628549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:01.628793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:01.630868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:01.630868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:01.630868 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] No waiting events found dispatching network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:01.630868 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-391011d7-8c84-498b-9810-e82115420df5 req-892e0500-6b5f-4382-8f89-db9d1d66d48e service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received unexpected event network-vif-plugged-5639f92a-8488-484a-a627-ab2b7a900da1 for instance with vm_state active and task_state None.
May 14 04:34:01.672624 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:01.672624 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:01.672624 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:34:01.911354 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:02.025039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.607s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:02.058010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:02.059211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:02.072350 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:02.075284 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733242.0750275, f2d96b98-baae-4f6a-96ef-39960a67461e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:02.075415 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] VM Resumed (Lifecycle Event)
May 14 04:34:02.179211 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:02.400445 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:02.578648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:02.583906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:02.599457 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:02.599774 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:02.623214 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updated VIF entry in instance network info cache for port 598ecf1f-7796-4592-ad4f-9b8dbfaf1323. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:02.624087 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating instance_info_cache with network_info: [{"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:02.684487 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:02.715305 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:02.715454 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing instance network info cache due to event network-changed-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:02.715572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] Acquiring lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:02.861291 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:03.103463 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:03.137076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-da4edd01-2d93-410b-bde0-a117a0fa1aea req-7f1d226f-6c39-490b-b8fa-61841399a469 service nova] Releasing lock "refresh_cache-d6c04f76-1f81-4921-ab27-3ff5b59b43b9" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:03.206567 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:03.206747 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:03.206898 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:03.207029 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] No VIF found with MAC fa:16:3e:eb:dd:74, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:03.362565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:03.363961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:34:03.364476 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] Acquired lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:03.364733 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Refreshing network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:03.367248 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating image(s)
May 14 04:34:03.367645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:03.368033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:03.368500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:03.368718 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'trusted_certs' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:03.492050 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-changed-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:03.492050 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Refreshing instance network info cache due to event network-changed-5639f92a-8488-484a-a627-ab2b7a900da1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:03.492050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] Acquiring lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:03.492050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] Acquired lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:03.492050 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Refreshing network info cache for port 5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:03.619640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.561s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:03.677380 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Deleted allocations for instance c89476d9-d45d-46db-86c5-12165dc40a93
May 14 04:34:03.868158 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:03.870368 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:03.870800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:03.871155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:03.995114 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:04.276942 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:04.473548 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updated VIF entry in instance network info cache for port 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:04.474088 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:04.502470 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:04.507477 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:04.690578 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updated VIF entry in instance network info cache for port 5639f92a-8488-484a-a627-ab2b7a900da1. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:04.691026 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating instance_info_cache with network_info: [{"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:04.698886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3faa4350-947d-44db-8174-ad3d062d18ba tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "c89476d9-d45d-46db-86c5-12165dc40a93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.970s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:04.822865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-562b6962-498d-4fa5-a8dd-3e75f3e00e81 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.661s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:04.948471 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:04.952682 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:04.953098 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:04.978987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e074c7a-dc70-4a6d-9b94-a900b9292119 req-3fcba0a4-1495-4d92-a949-03209d9f9b65 service nova] Releasing lock "refresh_cache-687170c3-d447-4e92-a5cc-979a86a38cd1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:05.061945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.part --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.062362 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] 4041593a-959f-4414-a75a-eb45497b3ff3 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:34:05.062966 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:34:05.063226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.part /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.196804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d5588cf2-7a72-4d7a-a00e-8f9ff0dc7ed3 req-6309c1ed-19da-4769-9573-914d6d2c1e91 service nova] Releasing lock "refresh_cache-f2d96b98-baae-4f6a-96ef-39960a67461e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:05.272877 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.part /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.converted" returned: 0 in 0.209s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.288649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.403254 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76.converted --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.404205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.533s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:05.404906 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:05.408390 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:05.409885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.532002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.535832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:05.536347 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:05.537185 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:05.543206 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:05.543803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.656549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.657733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76,backing_fmt=raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.726048 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76,backing_fmt=raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk 1073741824" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.726675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "a582519f36b8af7a3f0bd1efdf5491d24e073c76" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:05.727309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:05.824680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a582519f36b8af7a3f0bd1efdf5491d24e073c76 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:05.825586 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'migration_context' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:06.130045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:06.329226 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:06.329817 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Rebasing disk image.
May 14 04:34:06.330137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:06.395537 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:06.395781 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing instance network info cache due to event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:06.396008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:06.396163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:06.397846 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:06.440395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:06.441131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 -F raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:06.905248 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:07.455494 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:07.676086 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updated VIF entry in instance network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:07.676558 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:07.789054 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 -F raw /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk" returned: 0 in 1.348s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:07.789558 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:34:07.789781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Ensure instance console log exists: /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:34:07.790104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:07.790340 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:07.790535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:07.793820 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start _get_guest_xml network_info=[{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='9a32f8a5eab0878d955b5f7300c3bfce',container_format='bare',created_at=2026-05-14T04:33:39Z,direct_url=<?>,disk_format='qcow2',id=4041593a-959f-4414-a75a-eb45497b3ff3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1366242248-shelved',owner='4b66752be38742a38c2a4ef876561d9a',properties=ImageMetaProps,protected=<?>,size=53477376,status='active',tags=<?>,updated_at=2026-05-14T04:33:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '68a93f94-da8d-4038-aacf-28ce221e7e73', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '687170c3-d447-4e92-a5cc-979a86a38cd1', 'attached_at': '', 'detached_at': '', 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'serial': '94557006-4383-444b-9f3a-93dc68b3266e'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:34:07.799927 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:34:07.800370 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1366242248', uuid='687170c3-d447-4e92-a5cc-979a86a38cd1'), owner=OwnerMeta(userid='bd917914b2414921963ae67e7a9780f1', username='tempest-AttachVolumeShelveTestJSON-1339972729-project-member', projectid='4b66752be38742a38c2a4ef876561d9a', projectname='tempest-AttachVolumeShelveTestJSON-1339972729'), image=ImageMeta(id='4041593a-959f-4414-a75a-eb45497b3ff3', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733247.799752) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:34:07.801828 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:34:07.802768 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:34:07.803451 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:34:07.803695 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:34:07.804988 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:34:07.805666 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9a32f8a5eab0878d955b5f7300c3bfce',container_format='bare',created_at=2026-05-14T04:33:39Z,direct_url=<?>,disk_format='qcow2',id=4041593a-959f-4414-a75a-eb45497b3ff3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1366242248-shelved',owner='4b66752be38742a38c2a4ef876561d9a',properties=ImageMetaProps,protected=<?>,size=53477376,status='active',tags=<?>,updated_at=2026-05-14T04:33:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:34:07.806102 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:34:07.806332 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:34:07.806498 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:34:07.806719 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:34:07.806770 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:34:07.807010 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:34:07.807158 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:34:07.807373 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:34:07.807558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:34:07.807751 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:34:07.807973 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'vcpu_model' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:08.183067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c4ffa9a1-15ed-4a8f-a0e6-0119e811f9a1 req-61592ff4-dd44-4b5e-82d6-65a18720b27d service nova] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:08.310517 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:08.326506 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:34:08.327006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:08.327270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:08.327852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:08.328339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:34:08.342659 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:08.343435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:08.343828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:08.344059 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:34:08.344470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:08.344699 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:34:08.359453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:34:08.359453 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:08.364418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:34:08.364418 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:08.380814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e] added
May 14 04:34:08.380814 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:34:08.380814 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:08.380814 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:08.380814 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:08.380814 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:08.380814 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:08.381119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:34:08.381301 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:34:08.381948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e] added
May 14 04:34:08.381948 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:34:08.381948 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:08.381948 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:08.381948 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:08.381948 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:08.381948 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:08.382381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:34:08.382444 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:34:08.382702 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:34:08.382831 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:34:08.801478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:08.804365 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing instance network info cache due to event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:08.804365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:08.804365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:08.804365 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:09.113330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:09.113567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:09.308766 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:09.383088 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:34:09.383532 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:34:09.404390 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:34:09.404390 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:34:09.413047 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:34:09.413047 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.428171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.437690 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.449912 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.464098 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.464443 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:09.503804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.40.100,3260]
May 14 04:34:09.503804 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.40.100,3260] successful.
May 14 04:34:09.503804 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.507985 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:09.521342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.531076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.50.100,3260]
May 14 04:34:09.531076 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.50.100,3260] successful.
May 14 04:34:09.531076 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.544590 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:09.545526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:09.545526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:34:09.546396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] HCTL ('14', '-', '-', 0) found on session 101 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:34:09.546550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:34:09.556071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.574048 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:09.574796 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:09.574796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:34:09.576201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] HCTL ('15', '-', '-', 0) found on session 102 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:34:09.576201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:34:09.587128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching for a device in session 101 and hctl ['14', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:34:09.605351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching for a device in session 102 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:34:09.605351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:34:09.618506 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:34:09.816189 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:09.966465 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updated VIF entry in instance network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:09.966465 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:10.199077 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:10.200102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:10.204318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:34:10.204546 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Claim successful on node np0000000747
May 14 04:34:10.471008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-89f9617f-1a74-4d0b-9971-ff89653aa68f req-56b6b622-1251-465e-82d2-8cd537c532e1 service nova] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:10.588141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching for a device in session 101 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:34:10.588376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:34:11.134364 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:11.366883 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Found WWN 3300000007ba4f3a4 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:34:11.367750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:11.367750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000007ba4f3a4', 'path': '/dev/dm-7', 'multipath_id': '3300000007ba4f3a4'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:11.367987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ba4f3a4', 'path': '/dev/dm-7', 'multipath_id': '3300000007ba4f3a4'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:34:11.601944 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:11.602194 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:11.877102 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='4041593a-959f-4414-a75a-eb45497b3ff3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2120776940',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:58Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:33:46.389836',shelved_host='np0000000747',shelved_image_id='4041593a-959f-4414-a75a-eb45497b3ff3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:34:11.877317 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:11.878165 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:11.881501 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_devices' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:12.107443 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:12.383771 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:12.384929 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] End _get_guest_xml xml=<domain type="qemu">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <uuid>687170c3-d447-4e92-a5cc-979a86a38cd1</uuid>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <name>instance-0000002c</name>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1366242248</nova:name>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:34:07</nova:creationTime>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:user uuid="bd917914b2414921963ae67e7a9780f1">tempest-AttachVolumeShelveTestJSON-1339972729-project-member</nova:user>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:project uuid="4b66752be38742a38c2a4ef876561d9a">tempest-AttachVolumeShelveTestJSON-1339972729</nova:project>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         <nova:port uuid="5ea09587-45ea-4c3a-9c4d-d62f4a6dc453">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <system>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="serial">687170c3-d447-4e92-a5cc-979a86a38cd1</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="uuid">687170c3-d447-4e92-a5cc-979a86a38cd1</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </system>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <os>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </os>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <features>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </features>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   <devices>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <alias name="ua-94557006-4383-444b-9f3a-93dc68b3266e"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-7"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <target dev="vdc" bus="virtio"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <serial>94557006-4383-444b-9f3a-93dc68b3266e</serial>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:6e:2b:99"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <target dev="tap5ea09587-45"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </interface>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/console.log" append="off"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </serial>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <video>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </video>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </rng>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:   </devices>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]: </domain>
May 14 04:34:12.384929 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Preparing to wait for external event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='4041593a-959f-4414-a75a-eb45497b3ff3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2120776940',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:32:58Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:33:46.389836',shelved_host='np0000000747',shelved_image_id='4041593a-959f-4414-a75a-eb45497b3ff3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:34:12.386994 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:12.387323 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:12.387323 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:34:12.387768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.388132 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:12.388468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:34:12.389305 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.389494 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375cbffa-6214-598a-808a-a2ae18e32836', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:12.390311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.391097 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:12.391495 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.395815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.395987 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea09587-45, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:12.396999 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ea09587-45, col_values=(('qos', UUID('154e563b-ea0a-49ef-a1f3-3c797f9a3de3')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:12.396999 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ea09587-45, col_values=(('external_ids', {'iface-id': '5ea09587-45ea-4c3a-9c4d-d62f4a6dc453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2b:99', 'vm-uuid': '687170c3-d447-4e92-a5cc-979a86a38cd1'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:12.398089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.399308 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:12.407671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:12.409388 np0000000747 nova-compute[97971]: INFO os_vif [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45')
May 14 04:34:12.616187 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.416s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:12.616660 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:34:13.123055 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:34:13.123251 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:34:13.123557 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:13.123796 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:13.217040 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d28aa2d5d8d4d42931857f8b63ad188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1481ce79a54b72a2f83aa185ea46d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:34:13.625319 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:34:13.925921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:13.926059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:13.926265 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:13.926265 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No VIF found with MAC fa:16:3e:6e:2b:99, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:13.926908 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Using config drive
May 14 04:34:13.934076 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Successfully created port: 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:34:14.135881 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:34:14.430684 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'ec2_ids' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:14.508634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:14.508634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:14.509420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:14.509420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:14.509420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:14.518214 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Terminating instance
May 14 04:34:14.568525 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Successfully updated port: 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:34:14.615436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-changed-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:14.615954 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Refreshing instance network info cache due to event network-changed-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:14.616167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] Acquiring lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:14.616326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] Acquired lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:14.616505 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Refreshing network info cache for port 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:14.934017 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:14.934498 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'keypairs' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:15.023662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:34:15.052986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.058913 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.071722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:15.089416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.090300 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.119114 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:15.125458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.149506 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:34:15.150630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:34:15.151109 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Creating image(s)
May 14 04:34:15.152140 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:15.152558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:15.153252 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:15.153962 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:15.162007 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:15.167264 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.199638 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:15.248757 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:15.249695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:15.250377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:15.250377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:15.250377 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:15.250556 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0236754f-640c-4648-aaf3-59ec0f1362d4 req-290b453b-23aa-448d-9e68-ce1adced97c0 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:34:15.294013 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.127s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.294646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:15.295302 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:15.295481 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:15.298279 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:15.298714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.383307 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999320221999824 future=<Future at 0x7435f83843e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:15.385447 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Instance destroyed successfully.
May 14 04:34:15.387689 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lazy-loading 'resources' on Instance uuid 78a47990-a6d1-4617-8c1c-538889b9f34a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:15.412639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.114s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.415873 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.443460 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<687170c3-d447-4e92-a5cc-979a86a38cd1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:15.453457 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:15.464895 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:15.493679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk 1073741824" returned: 0 in 0.079s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.493679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:15.494049 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.548651 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0022756739999749698 future=<Future at 0x7435f8456270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:15.548651 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:15.548651 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.834497713000019 future=<Future at 0x7435f83843e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:15.550347 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Emitting event <LifecycleEvent: 1778733240.5446632, c89476d9-d45d-46db-86c5-12165dc40a93 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:15.551069 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.831131388999893 future=<Future at 0x7435f83843e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:15.551334 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] VM Stopped (Lifecycle Event)
May 14 04:34:15.611949 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:15.612523 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:15.651722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.157s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.652603 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:34:15.653632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.692809 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Creating config drive at /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config
May 14 04:34:15.702089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm1clfh7w {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:15.775051 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm1clfh7w" returned: 0 in 0.073s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.775704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:15.776207 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Cannot resize image /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:34:15.776779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:34:15.777033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Ensure instance console log exists: /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:34:15.777416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:15.777739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:15.777913 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:15.893743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1976191561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-serveractionsv293testjson-server-242034707',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7rjWn/56k+ChmrfzsZDaI90XMYTAZTGfbM/CYzM6bOv/X5efSyxYnj/hUpH4HK+CwAyn8ZtPtXwe26dD1FAURwgGFeZO+hthJkVHSgpvbdwef2AL9FB2uN3ftbEa31WA==',key_name='tempest-keypair-1600046213',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:33:36Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ca6721021640418a98b959a677f8a0',ramdisk_id='',reservation_id='r-uw0y6wzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c33366ff-2bc7-427b-a9a0-922bc7fdbf13',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1284155576',owner_user_name='tempest-ServerActionsV293TestJSON-1284155576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e18a4a18a9c458b90e48fa022b5e13c',uuid=78a47990-a6d1-4617-8c1c-538889b9f34a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:34:15.894069 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converting VIF {"id": "7a85c8c7-f3d6-4104-8047-287669c598a5", "address": "fa:16:3e:1e:dc:b3", "network": {"id": "bd068251-11d9-4472-9de0-002fdfad47f5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-483781631-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d8ca6721021640418a98b959a677f8a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a85c8c7-f3", "ovs_interfaceid": "7a85c8c7-f3d6-4104-8047-287669c598a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:15.894886 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:15.895157 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:34:15.897709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.897709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a85c8c7-f3, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:15.920746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.920746 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:15.927665 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.929156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.929156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13079a0a-3d9b-49fb-9b84-5697d7f31831) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:15.929635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.930558 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:15.940764 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:15.943333 np0000000747 nova-compute[97971]: INFO os_vif [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:dc:b3,bridge_name='br-int',has_traffic_filtering=True,id=7a85c8c7-f3d6-4104-8047-287669c598a5,network=Network(bd068251-11d9-4472-9de0-002fdfad47f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a85c8c7-f3')
May 14 04:34:15.946126 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:34:15.946764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:15.946990 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:15.947565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:15.948045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46977d6c-2c67-43ce-a101-9ed5481c354a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:34:15.948264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:34:15.972170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1621508d-e4fd-4304-ad98-09910b49f563 req-99699c64-18cb-4141-bfff-da8c585e4472 service nova] Releasing lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:15.972908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquired lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:15.973273 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:15.984294 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236 (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:15.985146 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:15.985146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d3c9d71-a3e1-4f22-b164-70245901c236', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:34:15.986763 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '91')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:15.990331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a', '92')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:15.991293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8494ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:34:15.991595 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:34:15.991953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Flush multipath device 330000000f525beb2 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:34:16.042426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:16.060746 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-2008ed2f-71f8-4a5c-8d01-7ccdeb9dbd6e tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: c89476d9-d45d-46db-86c5-12165dc40a93] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:16.095045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:16.136164 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.173157 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:34:16.173387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:34:16.174918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:34:16.188081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:34:16.188296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:34:16.205154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.243812 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.252590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260]
May 14 04:34:16.252590 np0000000747 nova-compute[97971]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.40.100,3260] successful.
May 14 04:34:16.252590 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.279654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.280120 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.300141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.337849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260]
May 14 04:34:16.337849 np0000000747 nova-compute[97971]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-46977d6c-2c67-43ce-a101-9ed5481c354a, portal: 192.168.50.100,3260] successful.
May 14 04:34:16.337849 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.363368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:16.363658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:16.363844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] <== disconnect_volume: return (417ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:16.365514 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:34:16.365514 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deleting instance files /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a_del
May 14 04:34:16.365514 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deletion of /opt/stack/data/nova/instances/78a47990-a6d1-4617-8c1c-538889b9f34a_del complete
May 14 04:34:16.387753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.554841 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:16.624603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.659345 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:16.767081 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:16.877605 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Took 1.85 seconds to destroy the instance on the hypervisor.
May 14 04:34:16.878363 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:34:16.879151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:34:16.879271 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:34:16.879610 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:16.938433 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating instance_info_cache with network_info: [{"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:16.970799 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:17.326280 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733257.3258107, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:17.326806 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Started (Lifecycle Event)
May 14 04:34:17.364851 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:17.365161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Acquiring lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:17.365386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:17.365572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:17.365766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] No waiting events found dispatching network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:17.365931 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-unplugged-7a85c8c7-f3d6-4104-8047-287669c598a5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:34:17.366105 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:17.366270 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:17.366470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:17.366654 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:17.366818 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Processing event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:34:17.366994 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:17.367152 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:17.367313 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:17.367471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:17.367624 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:17.370704 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d407bde4-bd96-4ad4-8a4b-5f61894ec6a8 req-1fd8f0b0-6708-4d1c-82fd-8b0d08d84906 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received unexpected event network-vif-plugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with vm_state shelved_offloaded and task_state spawning.
May 14 04:34:17.371800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:34:17.375344 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:34:17.380020 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance spawned successfully.
May 14 04:34:17.441002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Releasing lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:17.442042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance network_info: |[{"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:34:17.444100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Start _get_guest_xml network_info=[{"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:34:17.456369 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:34:17.458555 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1855610778', uuid='fb9eaac7-43db-4f85-9a60-5d8054da3c1e'), owner=OwnerMeta(userid='6d28aa2d5d8d4d42931857f8b63ad188', username='tempest-AttachVolumeNegativeTest-2053621712-project-member', projectid='9e1481ce79a54b72a2f83aa185ea46d1', projectname='tempest-AttachVolumeNegativeTest-2053621712'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733257.4575932) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:34:17.463809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:34:17.464547 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:34:17.466757 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:34:17.466757 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:34:17.467873 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:34:17.468296 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:34:17.468583 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:34:17.469202 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:34:17.469202 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:34:17.469202 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:34:17.469202 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:34:17.469461 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:34:17.469461 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:34:17.469912 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:34:17.469912 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:34:17.470100 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:34:17.486818 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1855610778',display_name='tempest-AttachVolumeNegativeTest-server-1855610778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-1855610778',id=50,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB5ddrMOIQe7bcjDQO/0puSo6ssgpqdLVND36pLr9MwcNd6bDVJQKcypKzMfV2rUTs8k1vx3yz/f0HpxU/+2hQtN6DhLTwXMb8pdeqHvIL30zgmA57h6zExWsXsR0KjYw==',key_name='tempest-keypair-2116521874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-g1s3akpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=fb9eaac7-43db-4f85-9a60-5d8054da3c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:34:17.487079 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:17.487800 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:17.488713 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'pci_devices' on Instance uuid fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:17.615966 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a596a826-e80a-4b60-b2b2-43de93d0c015 req-99f845f1-130d-4bee-a225-8805bf0736ab service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Received event network-vif-deleted-7a85c8c7-f3d6-4104-8047-287669c598a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:17.618177 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-a596a826-e80a-4b60-b2b2-43de93d0c015 req-99f845f1-130d-4bee-a225-8805bf0736ab service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Neutron deleted interface 7a85c8c7-f3d6-4104-8047-287669c598a5; detaching it from the instance and deleting it from the info cache
May 14 04:34:17.618392 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a596a826-e80a-4b60-b2b2-43de93d0c015 req-99f845f1-130d-4bee-a225-8805bf0736ab service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:17.816238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:17.830545 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:17.833022 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:17.992935 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <uuid>fb9eaac7-43db-4f85-9a60-5d8054da3c1e</uuid>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <name>instance-00000032</name>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1855610778</nova:name>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:34:17</nova:creationTime>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:user uuid="6d28aa2d5d8d4d42931857f8b63ad188">tempest-AttachVolumeNegativeTest-2053621712-project-member</nova:user>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:project uuid="9e1481ce79a54b72a2f83aa185ea46d1">tempest-AttachVolumeNegativeTest-2053621712</nova:project>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         <nova:port uuid="724c3b33-11f8-4ba6-84f0-9e77ac5a4d05">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <system>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="serial">fb9eaac7-43db-4f85-9a60-5d8054da3c1e</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="uuid">fb9eaac7-43db-4f85-9a60-5d8054da3c1e</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </system>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <os>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </os>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <features>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </features>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   <devices>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.config"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:bb:04:f6"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <target dev="tap724c3b33-11"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </interface>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/console.log" append="off"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </serial>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <video>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </video>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </rng>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:   </devices>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]: </domain>
May 14 04:34:17.992935 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Preparing to wait for external event network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1855610778',display_name='tempest-AttachVolumeNegativeTest-server-1855610778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-1855610778',id=50,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB5ddrMOIQe7bcjDQO/0puSo6ssgpqdLVND36pLr9MwcNd6bDVJQKcypKzMfV2rUTs8k1vx3yz/f0HpxU/+2hQtN6DhLTwXMb8pdeqHvIL30zgmA57h6zExWsXsR0KjYw==',key_name='tempest-keypair-2116521874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-g1s3akpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=fb9eaac7-43db-4f85-9a60-5d8054da3c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:34:17.995469 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:17.995813 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:17.995813 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea480d8-f4e0-5750-9ce6-4e8879834374', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:17.999631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:18.001521 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:18.001709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap724c3b33-11, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:18.002011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap724c3b33-11, col_values=(('qos', UUID('752e971b-9130-411e-ba4d-2211bc9a74f7')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:18.002245 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap724c3b33-11, col_values=(('external_ids', {'iface-id': '724c3b33-11f8-4ba6-84f0-9e77ac5a4d05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:04:f6', 'vm-uuid': 'fb9eaac7-43db-4f85-9a60-5d8054da3c1e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:18.006558 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:18.013871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:18.013871 np0000000747 nova-compute[97971]: INFO os_vif [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11')
May 14 04:34:18.041337 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:18.126861 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a596a826-e80a-4b60-b2b2-43de93d0c015 req-99f845f1-130d-4bee-a225-8805bf0736ab service nova] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Detach interface failed, port_id=7a85c8c7-f3d6-4104-8047-287669c598a5, reason: Instance 78a47990-a6d1-4617-8c1c-538889b9f34a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:34:18.329133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7f1e0b5c-99f7-4ca7-b477-35cf3a29eb6a tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.392s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:18.335056 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:34:18.335334 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733258.335159, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:18.335432 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Paused (Lifecycle Event)
May 14 04:34:18.546156 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Took 1.67 seconds to deallocate network for instance.
May 14 04:34:18.610211 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:18.610902 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:18.840079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:18.842103 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733258.841834, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:18.842223 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Resumed (Lifecycle Event)
May 14 04:34:19.107497 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:34:19.111692 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Deleting volume: 46977d6c-2c67-43ce-a101-9ed5481c354a {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:34:19.344873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:19.346774 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:19.539672 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:19.539807 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:19.539888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:bb:04:f6, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:19.540347 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Using config drive
May 14 04:34:19.671457 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:19.671645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:20.033635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:20.033635 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:20.045872 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:20.166004 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Creating config drive at /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.config
May 14 04:34:20.169931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpic5ei619 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:20.227459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpic5ei619" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:20.536929 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:20.602319 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:20.602770 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:20.609831 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:20.610249 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:20.727073 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:20.759093 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:20.879103 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:20.983094 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-78a66b45-3d47-4f20-b5c6-eaf3b8551419 req-0f26d53c-fbd9-4dbe-9258-f4e746150857 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:20.983446 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-78a66b45-3d47-4f20-b5c6-eaf3b8551419 req-0f26d53c-fbd9-4dbe-9258-f4e746150857 service nova] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:20.983676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-78a66b45-3d47-4f20-b5c6-eaf3b8551419 req-0f26d53c-fbd9-4dbe-9258-f4e746150857 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:20.983892 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-78a66b45-3d47-4f20-b5c6-eaf3b8551419 req-0f26d53c-fbd9-4dbe-9258-f4e746150857 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:20.987180 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-78a66b45-3d47-4f20-b5c6-eaf3b8551419 req-0f26d53c-fbd9-4dbe-9258-f4e746150857 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Processing event network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:34:21.050791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.377s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:21.100220 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:21.103509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:21.106338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:21.118721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:21.118963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:21.119122 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:21.119273 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:34:21.131560 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:21.138275 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Deleted allocations for instance 78a47990-a6d1-4617-8c1c-538889b9f34a
May 14 04:34:21.138275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:21.623773 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733261.6232429, fb9eaac7-43db-4f85-9a60-5d8054da3c1e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:21.624772 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:34:21.626696 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] VM Started (Lifecycle Event)
May 14 04:34:21.626871 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:34:21.632586 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance spawned successfully.
May 14 04:34:21.633030 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:34:22.129373 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:22.131001 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:22.148506 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.148739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.149140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.150279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-db3844a5-bd8a-4cd0-8660-a7e7ed445d85 tempest-ServerActionsV293TestJSON-1284155576 tempest-ServerActionsV293TestJSON-1284155576-project-member] Lock "78a47990-a6d1-4617-8c1c-538889b9f34a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.641s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:22.151118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.152735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.153192 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:22.175628 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:22.279272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:22.279794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:22.380658 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:22.381292 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:34:22.385477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:22.498347 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:22.498647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:22.617229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:22.628018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:22.646447 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:34:22.649632 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733262.6472652, fb9eaac7-43db-4f85-9a60-5d8054da3c1e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:22.649632 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] VM Paused (Lifecycle Event)
May 14 04:34:22.662626 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Took 7.51 seconds to spawn the instance on the hypervisor.
May 14 04:34:22.662906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:22.927006 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:22.927760 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:23.013526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:23.028143 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:23.033049 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:34:23.036231 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:23.066050 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:23.066473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:23.067288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:23.067288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:23.067288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] No waiting events found dispatching network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:23.067288 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8c57b5c2-5b0a-441c-bff3-435697e599b7 req-bc08ca62-9c11-43ec-b1d1-4e658d54e030 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received unexpected event network-vif-plugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 for instance with vm_state active and task_state None.
May 14 04:34:23.149064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:23.150792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:23.168679 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:23.176996 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733263.1764438, fb9eaac7-43db-4f85-9a60-5d8054da3c1e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:23.184707 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] VM Resumed (Lifecycle Event)
May 14 04:34:23.185678 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Took 13.06 seconds to build instance.
May 14 04:34:23.253880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:23.254354 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:34:23.257592 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:34:23.259027 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:23.320453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:23.320896 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12592MB free_disk=72.89174270629883GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:34:23.321062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:23.321424 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:23.688097 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:23.689107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.575s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:23.690384 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:24.132361 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-changed-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:24.132361 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Refreshing instance network info cache due to event network-changed-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:24.132361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] Acquiring lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:24.132493 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] Acquired lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:24.132610 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Refreshing network info cache for port 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:24.430264 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:34:24.430442 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance f2d96b98-baae-4f6a-96ef-39960a67461e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:34:24.430588 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:34:24.430756 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 687170c3-d447-4e92-a5cc-979a86a38cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:34:24.430908 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:34:24.431160 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:34:24.431351 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:34:23 up 34 min,  2 users,  load average: 9.37, 8.60, 5.06\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_4b66752be38742a38c2a4ef876561d9a': '1', 'io_workload': '0', 'num_proj_6495e941aabb4280afd6c384a250e6dd': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'num_proj_865fbadd3db24c0a95a089a1b63e6cf3': '1', 'num_proj_9e1481ce79a54b72a2f83aa185ea46d1': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:34:24.638364 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:24.726983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:24.811841 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:24.812055 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:25.094666 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:25.277715 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updated VIF entry in instance network info cache for port 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:25.278004 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating instance_info_cache with network_info: [{"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:25.314806 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:25.782272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-92d676da-f02e-43c2-9af0-a6a11e59922c req-dbac7bc3-b79f-4cb8-b69b-69670d2af778 service nova] Releasing lock "refresh_cache-fb9eaac7-43db-4f85-9a60-5d8054da3c1e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:25.825199 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:34:25.825342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.504s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:25.825934 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:26.140698 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:26.828791 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:26.829337 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:26.829960 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:26.830245 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:34:26.830402 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:34:26.830679 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.78 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:27.425710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:27.425898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:27.426097 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Rebooting instance
May 14 04:34:27.986346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:27.986807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:27.986807 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:34:28.014635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:28.488803 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:28.930756 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:29.457983 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:29.706646 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:30.209117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:30.383336 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0011010180000994296 future=<Future at 0x7435f83843e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:30.383875 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Emitting event <LifecycleEvent: 1778733255.3821013, 78a47990-a6d1-4617-8c1c-538889b9f34a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:30.384076 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:30.384216 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] VM Stopped (Lifecycle Event)
May 14 04:34:30.714057 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:30.897568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6f1f5106-63e6-455b-949c-9f591f02f662 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: 78a47990-a6d1-4617-8c1c-538889b9f34a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:30.919642 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:31.142087 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:33.016904 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:33.997359 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:33.997622 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:34.324612 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:34.327638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:34.349498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:34.375811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:34.502174 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:34:34.682681 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998783774999993 future=<Future at 0x7435f821ec30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:34.682937 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998434923999866 future=<Future at 0x7435f821ec30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:34.683115 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99829796899985 future=<Future at 0x7435f821ec30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:34.736204 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance shutdown successfully.
May 14 04:34:35.063515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:35.063515 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:35.068677 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:34:35.068677 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Claim successful on node np0000000747
May 14 04:34:35.222674 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.253401 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.256522 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.377230 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.537397 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.539217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.541973 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.564498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:35.583087 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:34:36.141448 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 due to new event <LifecycleEvent: 1778733276.1410885, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:34:36.141713 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733276.1410885, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:36.141837 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Resumed (Lifecycle Event)
May 14 04:34:36.144470 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:36.146086 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance running successfully.
May 14 04:34:36.146496 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance soft rebooted successfully.
May 14 04:34:36.146770 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:36.422469 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:36.424209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:36.424209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:36.424209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:36.424209 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:36.424209 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ab3a53ad-862a-4453-a3b7-f895ec0ebbcc req-bbcd0ec2-f973-4451-9336-eb1207119a57 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state active and task_state None.
May 14 04:34:36.477863 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:36.478171 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:36.645209 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:36.647399 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:36.656122 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1e2a7c13-9305-4172-ab49-59cf20f193c6 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.230s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:36.981303 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:37.150381 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733277.1500087, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:37.150606 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Started (Lifecycle Event)
May 14 04:34:37.442135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:37.442688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:37.489974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.426s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:37.490467 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:34:37.653783 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:37.655518 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:37.946101 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lazy-loading 'flavor' on Instance uuid d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:37.996161 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:34:37.996417 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:34:37.997056 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:37.997309 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:38.017998 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:38.078882 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a74e809c82bf46ce93759af89887f6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56a1dd0473425da8eddafc3d4c27a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:34:38.449366 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Ignoring supplied device name: /dev/vdb
May 14 04:34:38.500109 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:34:38.534966 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:38.535170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:38.536162 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:38.541217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:38.541217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:38.541217 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state active and task_state None.
May 14 04:34:38.541516 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:38.541779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:38.541779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:38.542020 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:38.542095 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:38.542287 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state active and task_state None.
May 14 04:34:38.542414 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:38.542683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:38.543250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:38.543250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:38.543250 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:38.543250 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-15af555c-c4ae-4168-a3b0-64e4f212e3b8 req-8732ca4f-c8d2-4abc-9eb5-e9f6e86ac580 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received unexpected event network-vif-plugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with vm_state active and task_state None.
May 14 04:34:38.663216 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Successfully created port: 2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:34:38.925822 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:38.953668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:39.003863 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:34:39.238260 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Successfully updated port: 2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:34:39.296279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-changed-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:39.296409 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Refreshing instance network info cache due to event network-changed-2769404f-a1f4-440a-97f5-692848a35083. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:39.296575 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] Acquiring lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:39.296662 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] Acquired lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:39.296788 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Refreshing network info cache for port 2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:39.740450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:39.798584 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:39.871119 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:40.016041 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:34:40.018648 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:34:40.019542 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Creating image(s)
May 14 04:34:40.019542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:40.019542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:40.021692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:40.023114 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:40.028183 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:40.032158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.054879 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:40.068230 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:40.068637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:40.068967 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Attaching volume 1b9b6fee-454f-4ad8-9e43-946339d14f56 to /dev/vdb
May 14 04:34:40.119760 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:40.135591 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:34:40.142790 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:40.143210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:40.143777 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:40.144194 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:40.152057 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:40.152830 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.171857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.217067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:34:40.217628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:34:40.233722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:34:40.235111 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe2f:8273', 'fe80::34ee:b8ff:fe2d:5ba6', 'fe80::fc16:3eff:fee7:2f04', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe6e:2b99', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:febb:4f6', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feeb:dd74', 'fe80::f880:e3ff:fe10:cad'] 
May 14 04:34:40.235321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:34:40.235469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:34:40.235641 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:40.236239 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating existing volume attachment record: 4cf5825a-8054-45b0-91b0-a30753c33ccb {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:34:40.270324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:40.271382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.340601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk 1073741824" returned: 0 in 0.069s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:40.341090 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:40.341557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.453827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:40.454454 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:34:40.454810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:40.558306 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:40.558306 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Cannot resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:34:40.558773 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:34:40.559994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-97eb1d8d-6896-452c-9628-f3ff25d2e6cb req-e212f22d-d6d3-4b59-84da-f97ed172eb3b service nova] Releasing lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:40.560459 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:34:40.561150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquired lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:40.561150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:40.561512 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:34:40.562703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:40.563070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:40.805656 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:34:40.806254 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:40.806491 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:40.806980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:40.807293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:34:40.823594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:40.824455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:40.825086 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:40.825671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:40.826081 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:34:40.826419 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:34:40.848105 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:34:40.848105 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:40.856151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:34:40.856151 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56] added
May 14 04:34:40.868046 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:40.868046 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:34:40.868046 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56] added
May 14 04:34:40.873007 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:34:40.873007 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:34:40.873007 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0474(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:34:40.873369 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:34:41.127674 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:41.154915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:41.299044 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:41.456723 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:41.868712 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:34:41.873572 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:34:41.887732 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:34:41.887732 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:34:41.896685 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:34:41.896685 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:41.902776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:41.912034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.925107 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.934237 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:41.934673 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:41.958868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Releasing lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:41.959252 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance network_info: |[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:34:41.961212 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start _get_guest_xml network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:34:41.964457 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:34:41.968147 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-655844742', uuid='ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'), owner=OwnerMeta(userid='a74e809c82bf46ce93759af89887f6b7', username='tempest-AttachVolumeTestJSON-948226058-project-member', projectid='7c56a1dd0473425da8eddafc3d4c27a7', projectname='tempest-AttachVolumeTestJSON-948226058'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733281.966542) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:34:41.972106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:34:41.972106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:34:41.972106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:34:41.972951 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:34:41.974533 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:34:41.974976 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:34:41.975693 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:34:41.975693 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:34:41.976134 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:34:41.976134 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:34:41.976737 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:34:41.976737 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:34:41.976896 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:34:41.977318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:34:41.977318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:34:41.977318 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:34:41.978115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.50.100,3260]
May 14 04:34:41.978115 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.50.100,3260] successful.
May 14 04:34:41.978115 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:41.995410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.40.100,3260]
May 14 04:34:41.995410 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.40.100,3260] successful.
May 14 04:34:41.995410 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:42.000052 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:34:42.000052 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:42.000052 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:42.000471 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'pci_devices' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:42.005950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:42.017426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.031779 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] HCTL ('9', '-', '-', 0) found on session 104 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:34:42.031779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.049122 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:42.049409 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:42.049715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:42.049796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:34:42.054498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] HCTL ('10', '-', '-', 0) found on session 105 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:34:42.054498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:34:42.057964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Searching for a device in session 104 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:34:42.059151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:34:42.071816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:34:42.071816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:34:42.503933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] End _get_guest_xml xml=<domain type="qemu">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <uuid>ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</uuid>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <name>instance-00000033</name>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeTestJSON-server-655844742</nova:name>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:34:41</nova:creationTime>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:user uuid="a74e809c82bf46ce93759af89887f6b7">tempest-AttachVolumeTestJSON-948226058-project-member</nova:user>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:project uuid="7c56a1dd0473425da8eddafc3d4c27a7">tempest-AttachVolumeTestJSON-948226058</nova:project>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         <nova:port uuid="2769404f-a1f4-440a-97f5-692848a35083">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <system>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="serial">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="uuid">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </system>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <os>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </os>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <features>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </features>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   <devices>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:de:75"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <target dev="tap2769404f-a1"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </interface>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/console.log" append="off"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </serial>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <video>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </video>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </rng>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:   </devices>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]: </domain>
May 14 04:34:42.503933 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:34:42.505921 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Preparing to wait for external event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:34:42.505921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:42.505921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:42.505921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:42.505921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:34:42.506138 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:42.506811 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:42.507075 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:34:42.507477 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:42.507713 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:42.508135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:34:42.509050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:42.509225 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8293de9c-b3f9-53a5-9134-c2c6844b1cdb', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:42.513487 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:42.516147 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:42.516385 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2769404f-a1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:42.516815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2769404f-a1, col_values=(('qos', UUID('93adbc56-9c67-4a89-afd7-16cd7664592f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:42.517052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2769404f-a1, col_values=(('external_ids', {'iface-id': '2769404f-a1f4-440a-97f5-692848a35083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:de:75', 'vm-uuid': 'ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:42.520940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:42.526454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:42.527810 np0000000747 nova-compute[97971]: INFO os_vif [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:34:42.826547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:34:43.845232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Found WWN 330000000fc956dee for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:34:43.845604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:43.845846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000fc956dee', 'path': '/dev/dm-1', 'multipath_id': '330000000fc956dee'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:43.846033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fc956dee', 'path': '/dev/dm-1', 'multipath_id': '330000000fc956dee'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:34:43.851310 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lazy-loading 'flavor' on Instance uuid d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:43.868962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:43.869189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:43.869354 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:43.871975 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97971) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 04:34:43.872527 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'flavor' on Instance uuid f2d96b98-baae-4f6a-96ef-39960a67461e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:44.049788 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:44.049921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:44.050653 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:9c:de:75, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:44.051212 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Using config drive
May 14 04:34:44.355495 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Attempting to attach volume 1b9b6fee-454f-4ad8-9e43-946339d14f56 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:34:44.357702 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:   <alias name="ua-1b9b6fee-454f-4ad8-9e43-946339d14f56"/>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:   <serial>1b9b6fee-454f-4ad8-9e43-946339d14f56</serial>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:44.357702 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:34:44.556219 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:44.783747 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Creating config drive at /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config
May 14 04:34:44.792657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwpwnceqa {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:44.851014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwpwnceqa" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:44.916684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:44.929869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:44.936231 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:44.940728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.014s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:44.943105 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:44.950877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:44.985488 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.125849 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:45.126054 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:45.126220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:45.126342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:45.126488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] No waiting events found dispatching network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:45.126655 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f5a8ddcd-4777-41f2-8326-478d461d7908 req-25401833-5ad2-4c18-a18e-f78873dcff7a service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received unexpected event network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 for instance with vm_state active and task_state powering-off.
May 14 04:34:45.363707 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99966760999996 future=<Future at 0x743618450d40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:45.363707 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance destroyed successfully.
May 14 04:34:45.364114 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'numa_topology' on Instance uuid f2d96b98-baae-4f6a-96ef-39960a67461e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:45.446099 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:34:45.501010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.538743 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.540393 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.633365 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.751818 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-28118331-b8b2-4a20-b324-0cf341082f2d req-0dbff362-0f90-4c20-b439-bda2dcfe0ca5 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:45.751818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28118331-b8b2-4a20-b324-0cf341082f2d req-0dbff362-0f90-4c20-b439-bda2dcfe0ca5 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:45.751999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28118331-b8b2-4a20-b324-0cf341082f2d req-0dbff362-0f90-4c20-b439-bda2dcfe0ca5 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:45.752136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-28118331-b8b2-4a20-b324-0cf341082f2d req-0dbff362-0f90-4c20-b439-bda2dcfe0ca5 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:45.752267 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-28118331-b8b2-4a20-b324-0cf341082f2d req-0dbff362-0f90-4c20-b439-bda2dcfe0ca5 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Processing event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:34:45.851953 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.862316 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.866903 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<f2d96b98-baae-4f6a-96ef-39960a67461e> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:34:45.867131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:45.867797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.896871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:45.906265 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:46.031296 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:46.031866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:46.037744 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:34:46.037744 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Claim successful on node np0000000747
May 14 04:34:46.039315 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:46.039983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:46.039983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:46.039983 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] No VIF found with MAC fa:16:3e:2f:82:73, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:46.156140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:46.381657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e4dbc81b-a449-49a6-a35c-980ae2a4949b tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.510s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:46.458868 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733286.4583452, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:46.459005 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Started (Lifecycle Event)
May 14 04:34:46.460244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:34:46.463531 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:34:46.466608 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance spawned successfully.
May 14 04:34:46.467071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:34:46.962328 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:46.966385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:46.979806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:46.980025 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:46.980418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:46.980752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:46.981206 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:46.984223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:47.217996 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:47.218221 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:47.218475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:47.219026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:47.219026 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] No waiting events found dispatching network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:47.219226 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dcafbb5e-bc69-4c44-a852-b99dc8cd573a req-5b5835ef-3042-49c5-8b12-5b91e501d4ae service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received unexpected event network-vif-unplugged-5639f92a-8488-484a-a627-ab2b7a900da1 for instance with vm_state stopped and task_state None.
May 14 04:34:47.470185 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:34:47.470560 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733287.4703007, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:47.470906 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Paused (Lifecycle Event)
May 14 04:34:47.494451 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Took 7.48 seconds to spawn the instance on the hypervisor.
May 14 04:34:47.495104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:47.519262 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:47.533576 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:47.533876 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:47.604495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e5940f3-ceb7-4747-8651-9f4194a3244a tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.536s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:47.841333 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:47.841504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:47.841858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:47.841858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:47.841977 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:47.842078 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-dc5badd4-12fd-432a-bde6-fb4540190135 req-6dbfc53b-401c-4f66-91a2-4e4f6f86369b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state active and task_state None.
May 14 04:34:47.844583 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event volume-extended-1b9b6fee-454f-4ad8-9e43-946339d14f56 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:47.979166 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:47.981329 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733287.9810848, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:47.981452 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Resumed (Lifecycle Event)
May 14 04:34:48.007566 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Took 13.00 seconds to build instance.
May 14 04:34:48.037916 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:48.347229 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Handling volume-extended event for volume 1b9b6fee-454f-4ad8-9e43-946339d14f56 {{(pid=97971) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 14 04:34:48.486805 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:48.495117 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:48.510649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d3991f2f-9d94-42fb-aa33-c75ffc8de7e2 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:48.544705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.513s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:48.545117 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:34:48.850024 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Cinder extended volume 1b9b6fee-454f-4ad8-9e43-946339d14f56; extending it to detect new size
May 14 04:34:49.052635 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:34:49.053250 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:34:49.053333 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:49.053652 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:49.134197 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dbaabfe41f14fa1bcff4d715af5f989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc8341628a343b88c90dd7e5d8e5427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:34:49.295833 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-changed-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:49.295833 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Refreshing instance network info cache due to event network-changed-2769404f-a1f4-440a-97f5-692848a35083. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:49.295833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] Acquiring lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:49.295833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] Acquired lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:49.295833 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Refreshing network info cache for port 2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:49.387301 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] calling os-brick to extend iSCSI Volume {{(pid=97971) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 14 04:34:49.387692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}), 'kwargs': {}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:49.388895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:49.391785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:49.391785 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}
May 14 04:34:49.391785 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Multipath discovery for iSCSI enabled
May 14 04:34:49.391785 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0']
May 14 04:34:49.391785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0'] {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 14 04:34:49.419664 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0'] {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 14 04:34:49.419664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Running cmd (subprocess): lsscsi {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:49.474601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] CMD "lsscsi" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:49.476243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97971) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 14 04:34:49.476243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 14 04:34:49.486718 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Starting size: 1073741824 {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 14 04:34:49.516689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] volume size after scsi device rescan 2147483648 {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 14 04:34:49.516689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Running cmd (subprocess): lsscsi {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:49.555765 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:34:49.587137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] CMD "lsscsi" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:49.587137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97971) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 14 04:34:49.587137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 14 04:34:49.604237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Starting size: 1073741824 {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 14 04:34:49.646099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] volume size after scsi device rescan 2147483648 {{(pid=97971) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 14 04:34:49.657624 np0000000747 nova-compute[97971]: INFO os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Find Multipath device file for volume WWN 330000000fc956dee
May 14 04:34:49.658071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000fc956dee exists yet. {{(pid=97971) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 14 04:34:49.658305 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] /dev/disk/by-id/dm-uuid-mpath-330000000fc956dee has shown up. {{(pid=97971) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 14 04:34:49.682081 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005797610001536668 future=<Future at 0x7435f821ec30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:49.682081 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:49.682314 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.680018805000145 future=<Future at 0x743618450d40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:49.682314 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.679931502000272 future=<Future at 0x743618450d40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:49.692586 np0000000747 nova-compute[97971]: INFO os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000fc956dee) current size 1073741824
May 14 04:34:49.790304 np0000000747 nova-compute[97971]: INFO os_brick.initiator.linuxscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000fc956dee) new size 2147483648
May 14 04:34:49.790482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.401s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:49.790600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] <== extend_volume: return (401ms) 2147483648 {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:49.791898 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Extend iSCSI Volume: new_size=2147483648 {{(pid=97971) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 14 04:34:49.799212 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:49.806356 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [req-be5c56e1-7756-41d8-b6cd-0b32b27b4438 req-266c27be-868f-44fb-bfd2-c9a0a616037f service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Resizing target device /dev/dm-1 to 2147483648 {{(pid=97971) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 14 04:34:49.891251 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Successfully created port: d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:34:50.065219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:34:50.278099 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:50.445708 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updated VIF entry in instance network info cache for port 2769404f-a1f4-440a-97f5-692848a35083. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:34:50.446231 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:50.496176 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Successfully updated port: d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:34:50.558113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-changed-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:50.558389 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Refreshing instance network info cache due to event network-changed-d819937e-c482-4d8c-85d3-10cd3f016c1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:34:50.558761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] Acquiring lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:50.558906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] Acquired lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:50.559163 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Refreshing network info cache for port d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:34:50.948888 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b09bc2db-69b3-4862-9fc0-890c4ca01470 req-07823e8c-d902-4175-9f07-bef2ac02ed5e service nova] Releasing lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:51.002636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:34:51.061245 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:51.080943 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:34:51.081984 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:34:51.082247 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Creating image(s)
May 14 04:34:51.084675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.088639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.088639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:51.088639 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:51.092975 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:51.094333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:51.161872 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:51.173082 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:51.210606 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:51.214634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.214634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.214634 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:51.219136 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:34:51.219933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:51.329052 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:51.332773 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:51.378018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.378464 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.379510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.379881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.380052 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:51.387760 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Terminating instance
May 14 04:34:51.421523 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:51.423320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk 1073741824" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:51.426632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:51.426632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:51.514867 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.515179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.535150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:51.538643 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:34:51.538643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:51.638742 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:51.639340 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Cannot resize image /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:34:51.639887 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:34:51.640148 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Ensure instance console log exists: /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:34:51.640477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:51.640800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:51.641026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:51.893823 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:34:51.900723 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Instance destroyed successfully.
May 14 04:34:51.901341 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid f2d96b98-baae-4f6a-96ef-39960a67461e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:51.924234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2393353d-d69c-43ba-9be1-875c75b6cb23 req-acf7dd6f-9a4c-4f07-9330-ebc256a95d8b service nova] Releasing lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:51.924595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquired lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:34:51.924805 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:34:52.018522 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Detaching volume 1b9b6fee-454f-4ad8-9e43-946339d14f56
May 14 04:34:52.057400 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Attempting to driver detach volume 1b9b6fee-454f-4ad8-9e43-946339d14f56 from mountpoint /dev/vdb
May 14 04:34:52.063037 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Found disk vdb by alias ua-1b9b6fee-454f-4ad8-9e43-946339d14f56 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:34:52.065564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Found disk vdb by alias ua-1b9b6fee-454f-4ad8-9e43-946339d14f56 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:34:52.065564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Attempting to detach device vdb from instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:34:52.065564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <alias name="ua-1b9b6fee-454f-4ad8-9e43-946339d14f56"/>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <serial>1b9b6fee-454f-4ad8-9e43-946339d14f56</serial>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:52.065564 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:34:52.069693 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Successfully detached device vdb from instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 from the persistent domain config.
May 14 04:34:52.069854 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] (1/8): Attempting to detach device vdb with device alias ua-1b9b6fee-454f-4ad8-9e43-946339d14f56 from instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:34:52.070091 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <alias name="ua-1b9b6fee-454f-4ad8-9e43-946339d14f56"/>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <serial>1b9b6fee-454f-4ad8-9e43-946339d14f56</serial>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:52.070091 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:34:52.404417 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822614431',display_name='tempest-TestVolumeBootPattern-server-1822614431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1822614431',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM325XYBnrm0g4jbxRwUCN2TSGnobJ57LNXfUwZwj+cCVfF3i9OswYXn0bbcVt/+OiCw769GkVQTbUwqf4Ffld/5hvdp+UiCyHHsN6tNECqNkMIzbWoDvwH5CI1OMH9DKQ==',key_name='tempest-keypair-95157993',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:01Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-ybdgw1cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=f2d96b98-baae-4f6a-96ef-39960a67461e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:34:52.405083 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5639f92a-8488-484a-a627-ab2b7a900da1", "address": "fa:16:3e:e7:2f:04", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5639f92a-84", "ovs_interfaceid": "5639f92a-8488-484a-a627-ab2b7a900da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:52.405520 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:52.405827 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:34:52.409684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:52.409684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5639f92a-84, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:52.418799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:52.419503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:52.421396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:52.421396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4288ab0c-5816-4f1e-8e70-a6ce8dca462f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:52.422702 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:52.422702 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:52.425315 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:52.429283 np0000000747 nova-compute[97971]: INFO os_vif [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=5639f92a-8488-484a-a627-ab2b7a900da1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5639f92a-84')
May 14 04:34:52.433272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:34:52.433761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:52.433962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:52.434545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:52.435009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f022989-b0e9-46ab-82b5-b05c89434667', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:34:52.435266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.472549 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667 (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.472996 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:34:52.472996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '96')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:52.474022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667', '97')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:52.477407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618388ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:34:52.477778 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdh, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:34:52.478166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 33000000099207f86 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:34:52.521794 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:34:52.530303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:52.578374 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:52.615287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:34:52.615468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:34:52.617161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:34:52.629078 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:34:52.629317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:34:52.644221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.686013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.40.100,3260]
May 14 04:34:52.686013 np0000000747 nova-compute[97971]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.40.100,3260] successful.
May 14 04:34:52.686013 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.699591 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:52.708586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.719936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.732713 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733292.7323172, d6c04f76-1f81-4921-ab27-3ff5b59b43b9 => ua-1b9b6fee-454f-4ad8-9e43-946339d14f56> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:34:52.735400 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1b9b6fee-454f-4ad8-9e43-946339d14f56 for instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:34:52.740904 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Successfully detached device vdb from instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 from the live domain config.
May 14 04:34:52.742205 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:34:52.742341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:52.742547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:52.754691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.50.100,3260]
May 14 04:34:52.754691 np0000000747 nova-compute[97971]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-8f022989-b0e9-46ab-82b5-b05c89434667, portal: 192.168.50.100,3260] successful.
May 14 04:34:52.754691 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (343ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Deleting instance files /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e_del
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.037s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b9b6fee-454f-4ad8-9e43-946339d14f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:34:52.791781 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Deletion of /opt/stack/data/nova/instances/f2d96b98-baae-4f6a-96ef-39960a67461e_del complete
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.815823 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56 (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:52.816276 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:52.816276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '105'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:34:52.816575 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '105')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:52.817528 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56', '104')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:52.818639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618388ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:34:52.818924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:34:52.819201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Flush multipath device 330000000fc956dee {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:34:52.858864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:52.863241 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating instance_info_cache with network_info: [{"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:52.903395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:52.948269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:34:52.948480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:34:52.949593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:34:52.961904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:34:52.962147 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:34:52.973268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.007297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.40.100,3260]
May 14 04:34:53.007297 np0000000747 nova-compute[97971]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.40.100,3260] successful.
May 14 04:34:53.007297 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.023949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.037627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.072120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.50.100,3260]
May 14 04:34:53.072120 np0000000747 nova-compute[97971]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-1b9b6fee-454f-4ad8-9e43-946339d14f56, portal: 192.168.50.100,3260] successful.
May 14 04:34:53.072120 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.089400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:53.089732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:53.089954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] <== disconnect_volume: return (347ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:53.090077 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:34:53.290485 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:34:53.290949 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:34:53.291369 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:34:53.291559 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:34:53.291881 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:53.366310 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Releasing lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:34:53.366633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance network_info: |[{"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:34:53.369211 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Start _get_guest_xml network_info=[{"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:34:53.373117 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:34:53.375076 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-905468649', uuid='61825815-2fef-44e5-bdb6-4f40ea7e49fe'), owner=OwnerMeta(userid='7dbaabfe41f14fa1bcff4d715af5f989', username='tempest-VolumesBackupsTest-1649149288-project-member', projectid='ffc8341628a343b88c90dd7e5d8e5427', projectname='tempest-VolumesBackupsTest-1649149288'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733293.3745468) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:34:53.376929 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:34:53.377522 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:34:53.379268 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:34:53.381212 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:53.382325 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:34:53.383630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:34:53.384250 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:34:53.384250 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:34:53.384250 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:34:53.384449 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:34:53.384516 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:34:53.384671 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:34:53.385275 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:34:53.385275 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:34:53.385593 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:34:53.385753 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:34:53.386034 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:34:53.404578 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-905468649',display_name='tempest-VolumesBackupsTest-instance-905468649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-905468649',id=52,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfamFBr/1E07NVTKQCg9j1N6uTn37j1OxSoxdOajA5MY3b6bmpnbxikUVxyzTD51FYgHWmwK0sX9XSP/aQxKQ4m/xKAF4tjht56p8CNmnudxZAf0myRPU3uhrLdyUtPFQ==',key_name='tempest-keypair-1567023603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-c1lvh4sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=61825815-2fef-44e5-bdb6-4f40ea7e49fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:34:53.405278 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:53.405829 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:53.406749 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'pci_devices' on Instance uuid 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:53.667909 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lazy-loading 'flavor' on Instance uuid d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:53.909772 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] End _get_guest_xml xml=<domain type="qemu">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <uuid>61825815-2fef-44e5-bdb6-4f40ea7e49fe</uuid>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <name>instance-00000034</name>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumesBackupsTest-instance-905468649</nova:name>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:34:53</nova:creationTime>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:user uuid="7dbaabfe41f14fa1bcff4d715af5f989">tempest-VolumesBackupsTest-1649149288-project-member</nova:user>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:project uuid="ffc8341628a343b88c90dd7e5d8e5427">tempest-VolumesBackupsTest-1649149288</nova:project>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         <nova:port uuid="d819937e-c482-4d8c-85d3-10cd3f016c1b">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <system>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="serial">61825815-2fef-44e5-bdb6-4f40ea7e49fe</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="uuid">61825815-2fef-44e5-bdb6-4f40ea7e49fe</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </system>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <os>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </os>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <features>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </features>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   <devices>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.config"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </disk>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:e8:33:8a"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <target dev="tapd819937e-c4"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </interface>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/console.log" append="off"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </serial>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <video>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </video>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </rng>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:   </devices>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]: </domain>
May 14 04:34:53.909772 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Preparing to wait for external event network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-905468649',display_name='tempest-VolumesBackupsTest-instance-905468649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-905468649',id=52,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfamFBr/1E07NVTKQCg9j1N6uTn37j1OxSoxdOajA5MY3b6bmpnbxikUVxyzTD51FYgHWmwK0sX9XSP/aQxKQ4m/xKAF4tjht56p8CNmnudxZAf0myRPU3uhrLdyUtPFQ==',key_name='tempest-keypair-1567023603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-c1lvh4sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=61825815-2fef-44e5-bdb6-4f40ea7e49fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:34:53.912064 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:53.913940 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:53.914163 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:34:53.914510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:53.914775 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:53.914977 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:34:53.915925 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:53.916114 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52ca763b-4e93-58a2-ac81-4b7bcb3212a9', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:53.918077 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:53.919363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:53.921591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:53.921899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd819937e-c4, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:53.922342 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd819937e-c4, col_values=(('qos', UUID('7ac7a464-0743-4a90-a63c-372dc0dcc0d6')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:53.922609 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd819937e-c4, col_values=(('external_ids', {'iface-id': 'd819937e-c482-4d8c-85d3-10cd3f016c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:33:8a', 'vm-uuid': '61825815-2fef-44e5-bdb6-4f40ea7e49fe'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:53.926186 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:53.931259 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:53.931714 np0000000747 nova-compute[97971]: INFO os_vif [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4')
May 14 04:34:53.978293 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-927ad604-fa71-49ba-a4e5-e5980b2f87ae req-4cfbffaa-91bd-4f3a-9090-41c3f9432069 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Received event network-vif-deleted-5639f92a-8488-484a-a627-ab2b7a900da1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:53.978782 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-927ad604-fa71-49ba-a4e5-e5980b2f87ae req-4cfbffaa-91bd-4f3a-9090-41c3f9432069 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Neutron deleted interface 5639f92a-8488-484a-a627-ab2b7a900da1; detaching it from the instance and deleting it from the info cache
May 14 04:34:53.978958 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-927ad604-fa71-49ba-a4e5-e5980b2f87ae req-4cfbffaa-91bd-4f3a-9090-41c3f9432069 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:54.408337 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:54.482232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-927ad604-fa71-49ba-a4e5-e5980b2f87ae req-4cfbffaa-91bd-4f3a-9090-41c3f9432069 service nova] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Detach interface failed, port_id=5639f92a-8488-484a-a627-ab2b7a900da1, reason: Instance f2d96b98-baae-4f6a-96ef-39960a67461e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:34:54.674666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9d8773d-46c5-417f-969a-55db4a6282ba tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.159s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:54.785628 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:54.786703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:54.786703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:54.786703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:54.787889 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:54.792746 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Terminating instance
May 14 04:34:54.910390 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Took 1.62 seconds to deallocate network for instance.
May 14 04:34:55.296257 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:34:55.332210 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.337200 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.357937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.364381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.381748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.392018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.454509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:55.454509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:34:55.454509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No VIF found with MAC fa:16:3e:e8:33:8a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:34:55.455339 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Using config drive
May 14 04:34:55.474362 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:34:55.522378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:55.522896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:55.606426 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.620601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:55.635014 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999652212 future=<Future at 0x7436184f45f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:34:55.642735 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Instance destroyed successfully.
May 14 04:34:55.643296 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lazy-loading 'resources' on Instance uuid d6c04f76-1f81-4921-ab27-3ff5b59b43b9 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:55.968163 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:55.980793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:55.980944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:56.025332 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Detaching volume 94557006-4383-444b-9f3a-93dc68b3266e
May 14 04:34:56.078037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:56.079244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:56.079754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:56.079915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:56.080605 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] No waiting events found dispatching network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:56.080605 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:34:56.080605 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:56.080605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Acquiring lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:56.080605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:56.080847 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:56.081243 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] No waiting events found dispatching network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:56.081243 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ed46ef-32cc-44fc-af37-b2318224968a req-b26652c5-764e-4716-947d-427542d6dcea service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-unplugged-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:34:56.091019 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Attempting to driver detach volume 94557006-4383-444b-9f3a-93dc68b3266e from mountpoint /dev/vdc
May 14 04:34:56.094762 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Found disk vdc by alias ua-94557006-4383-444b-9f3a-93dc68b3266e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:34:56.095753 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Found disk vdc by alias ua-94557006-4383-444b-9f3a-93dc68b3266e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:34:56.095893 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Attempting to detach device vdc from instance 687170c3-d447-4e92-a5cc-979a86a38cd1 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:34:56.096092 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <alias name="ua-94557006-4383-444b-9f3a-93dc68b3266e"/>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <serial>94557006-4383-444b-9f3a-93dc68b3266e</serial>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:56.096092 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:34:56.101009 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully detached device vdc from instance 687170c3-d447-4e92-a5cc-979a86a38cd1 from the persistent domain config.
May 14 04:34:56.101009 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] (1/8): Attempting to detach device vdc with device alias ua-94557006-4383-444b-9f3a-93dc68b3266e from instance 687170c3-d447-4e92-a5cc-979a86a38cd1 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:34:56.101916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <alias name="ua-94557006-4383-444b-9f3a-93dc68b3266e"/>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <serial>94557006-4383-444b-9f3a-93dc68b3266e</serial>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]: </disk>
May 14 04:34:56.101916 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:34:56.146955 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1910509060',display_name='tempest-VolumesExtendAttachedTest-instance-1910509060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesextendattachedtest-instance-1910509060',id=49,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWTy2VtA84PPnVinojO4bZuhZtayLde2ad4kiLwNqNHZMWn0rJnR5AuV7/T87S/l6R2b6IflVR4Pvw6hZ6waPiXlafkTsxvNJCNcyk/Piwdg4lStozOcOY7pfduyH0/Lw==',key_name='tempest-keypair-1538462261',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:33:59Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='865fbadd3db24c0a95a089a1b63e6cf3',ramdisk_id='',reservation_id='r-tubqv3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-676713984',owner_user_name='tempest-VolumesExtendAttachedTest-676713984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d9dc4d2831e4439bc7a9e419dbfa358',uuid=d6c04f76-1f81-4921-ab27-3ff5b59b43b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:34:56.146955 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converting VIF {"id": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "address": "fa:16:3e:2f:82:73", "network": {"id": "d65fe946-ea88-4d08-af24-a37f5a9098ba", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-617940937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "865fbadd3db24c0a95a089a1b63e6cf3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap598ecf1f-77", "ovs_interfaceid": "598ecf1f-7796-4592-ad4f-9b8dbfaf1323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:34:56.147704 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:34:56.148039 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:34:56.149572 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.149798 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598ecf1f-77, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:56.153857 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.154694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:56.157689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.158610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.158767 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35b59387-b4d9-4d19-9157-0c149ce4db84) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:34:56.159508 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.159751 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:34:56.166496 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.168886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.175883 np0000000747 nova-compute[97971]: INFO os_vif [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:82:73,bridge_name='br-int',has_traffic_filtering=True,id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323,network=Network(d65fe946-ea88-4d08-af24-a37f5a9098ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598ecf1f-77')
May 14 04:34:56.176243 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Deleting instance files /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9_del
May 14 04:34:56.177222 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Deletion of /opt/stack/data/nova/instances/d6c04f76-1f81-4921-ab27-3ff5b59b43b9_del complete
May 14 04:34:56.185998 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Creating config drive at /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.config
May 14 04:34:56.192237 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpymcag7bt {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:34:56.256482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpymcag7bt" returned: 0 in 0.064s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:34:56.509112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:56.509694 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:56.704386 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:34:56.706694 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:34:56.707112 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:34:56.707282 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:34:56.707818 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:56.771030 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:34:56.803911 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733296.8033938, 687170c3-d447-4e92-a5cc-979a86a38cd1 => ua-94557006-4383-444b-9f3a-93dc68b3266e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:34:56.809395 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-94557006-4383-444b-9f3a-93dc68b3266e for instance 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:34:56.817279 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully detached device vdc from instance 687170c3-d447-4e92-a5cc-979a86a38cd1 from the live domain config.
May 14 04:34:56.819503 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:34:56.819901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:34:56.820035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:34:56.820426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:34:56.820957 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94557006-4383-444b-9f3a-93dc68b3266e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:34:56.820957 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:34:56.846971 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.859396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:34:56.868636 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:34:56.868636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '101')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:56.869521 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e', '102')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:34:56.870473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618278720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:34:56.870811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Removing multipathed devices sdj, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:34:56.871344 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flush multipath device 3300000007ba4f3a4 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:34:56.915408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:56.961654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:34:56.965670 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.013815 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:57.025061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:34:57.025061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:34:57.026184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:34:57.050106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:34:57.050404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:34:57.065296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.101458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.40.100,3260]
May 14 04:34:57.101458 np0000000747 nova-compute[97971]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.40.100,3260] successful.
May 14 04:34:57.101458 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.122684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.141955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.176417 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.50.100,3260]
May 14 04:34:57.176417 np0000000747 nova-compute[97971]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-94557006-4383-444b-9f3a-93dc68b3266e, portal: 192.168.50.100,3260] successful.
May 14 04:34:57.176417 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.197324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:34:57.197834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:34:57.198232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] <== disconnect_volume: return (378ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:34:57.198491 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:34:57.256545 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.260202 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.272192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.274593 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.299900 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:34:57.452813 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940eb8a9-cd0c-47be-8d2d-993b014484cf req-2424398a-089a-46d0-84a6-916b92142afb service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Received event network-vif-deleted-598ecf1f-7796-4592-ad4f-9b8dbfaf1323 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:57.452813 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-940eb8a9-cd0c-47be-8d2d-993b014484cf req-2424398a-089a-46d0-84a6-916b92142afb service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Neutron deleted interface 598ecf1f-7796-4592-ad4f-9b8dbfaf1323; detaching it from the instance and deleting it from the info cache
May 14 04:34:57.452813 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-940eb8a9-cd0c-47be-8d2d-993b014484cf req-2424398a-089a-46d0-84a6-916b92142afb service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:57.532410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.551s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:57.602657 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance f2d96b98-baae-4f6a-96ef-39960a67461e
May 14 04:34:57.751533 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733297.751212, 61825815-2fef-44e5-bdb6-4f40ea7e49fe => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:57.751750 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] VM Started (Lifecycle Event)
May 14 04:34:57.767273 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'flavor' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:34:57.853933 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:34:57.959149 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940eb8a9-cd0c-47be-8d2d-993b014484cf req-2424398a-089a-46d0-84a6-916b92142afb service nova] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Detach interface failed, port_id=598ecf1f-7796-4592-ad4f-9b8dbfaf1323, reason: Instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:34:58.154343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:58.154343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:58.154343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:58.154343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:58.154343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Processing event network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:34:58.158018 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:34:58.158800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:34:58.159517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:58.159909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:58.160094 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:58.161222 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] No waiting events found dispatching network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:34:58.163120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:34:58.163507 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ed9b62f3-da5f-4b29-aa59-3a1ecf2a1470 req-53e000ad-587d-4277-9292-64057cb8ff5c service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received unexpected event network-vif-plugged-d819937e-c482-4d8c-85d3-10cd3f016c1b for instance with vm_state building and task_state spawning.
May 14 04:34:58.169299 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance spawned successfully.
May 14 04:34:58.169754 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:34:58.256191 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:58.261262 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:34:58.356322 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Took 1.65 seconds to deallocate network for instance.
May 14 04:34:58.614536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c7401861-b1df-473a-99ec-f998c61207ff tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "f2d96b98-baae-4f6a-96ef-39960a67461e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.236s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.678636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:34:58.763606 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:34:58.763859 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733298.7636776, 61825815-2fef-44e5-bdb6-4f40ea7e49fe => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:58.763979 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] VM Paused (Lifecycle Event)
May 14 04:34:58.773401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e56224a0-4ee2-4908-83f6-1a3b36bfe06b tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:34:58.863541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:34:58.864394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:34:59.188935 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Took 8.11 seconds to spawn the instance on the hypervisor.
May 14 04:34:59.189357 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:59.254033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:34:59.254292 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:34:59.267228 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:59.270004 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733299.2696564, 61825815-2fef-44e5-bdb6-4f40ea7e49fe => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:34:59.270310 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] VM Resumed (Lifecycle Event)
May 14 04:34:59.703285 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Took 13.75 seconds to build instance.
May 14 04:34:59.756934 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:34:59.774416 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:34:59.777711 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:00.175657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:00.175884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:00.176061 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:00.176199 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:00.176332 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:00.178410 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Terminating instance
May 14 04:35:00.206199 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.266s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:00.266119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.402s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:00.349456 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Deleted allocations for instance d6c04f76-1f81-4921-ab27-3ff5b59b43b9
May 14 04:35:00.363754 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.001360948999717948 future=<Future at 0x743618450d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:00.363754 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:00.363915 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.2707347329997 future=<Future at 0x7436184f45f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:00.363970 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.270659201999933 future=<Future at 0x7436184f45f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:00.364186 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733285.3622024, f2d96b98-baae-4f6a-96ef-39960a67461e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:00.364298 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] VM Stopped (Lifecycle Event)
May 14 04:35:00.682497 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:35:00.706422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:00.711902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:00.736600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:00.742172 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:00.768137 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:00.857396 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-changed-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:00.857623 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Refreshing instance network info cache due to event network-changed-d819937e-c482-4d8c-85d3-10cd3f016c1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:00.857836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] Acquiring lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:00.863801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] Acquired lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:00.864103 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Refreshing network info cache for port d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:00.866801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f4162af6-c556-4781-ac29-6b5961272cd8 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: f2d96b98-baae-4f6a-96ef-39960a67461e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:00.892324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:00.894785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:00.894785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:00.894785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:00.894785 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:00.894785 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4117532f-6bd0-4926-9c2e-8a66e044568a req-615a5e88-fe7a-401f-99dc-68a4fd5840d4 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:01.055640 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999758470000415 future=<Future at 0x7436184f4d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:01.058192 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Instance destroyed successfully.
May 14 04:35:01.058701 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'resources' on Instance uuid 687170c3-d447-4e92-a5cc-979a86a38cd1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:01.160254 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.171252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.367060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa947b16-52ad-45de-9357-39751dc23ed6 tempest-VolumesExtendAttachedTest-676713984 tempest-VolumesExtendAttachedTest-676713984-project-member] Lock "d6c04f76-1f81-4921-ab27-3ff5b59b43b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.581s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:01.369212 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:01.561416 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1366242248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1366242248',id=44,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtb9QV4XvuBfnA05emM57/WcWso8r5NPfBec5Tu1J8nYM7V3/ara2n6gEVXGlEjV8TqoijahoZLcyalP/n57ysp6rDOYfUeS2g5hOuOvgVqsXsosTTJa9jm3ccNaIxcOQ==',key_name='tempest-keypair-2120776940',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:17Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-bcyjt73v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=687170c3-d447-4e92-a5cc-979a86a38cd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:35:01.561727 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "address": "fa:16:3e:6e:2b:99", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea09587-45", "ovs_interfaceid": "5ea09587-45ea-4c3a-9c4d-d62f4a6dc453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:01.562544 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:01.562875 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:35:01.565768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.565768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea09587-45, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:01.567474 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.569161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:01.569303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.571059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.571160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=154e563b-ea0a-49ef-a1f3-3c797f9a3de3) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:01.572210 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.573025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:01.576291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:01.578152 np0000000747 nova-compute[97971]: INFO os_vif [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea09587-45')
May 14 04:35:01.578467 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Deleting instance files /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1_del
May 14 04:35:01.586784 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Deletion of /opt/stack/data/nova/instances/687170c3-d447-4e92-a5cc-979a86a38cd1_del complete
May 14 04:35:01.718082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:01.720143 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:01.794596 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:01.966904 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updated VIF entry in instance network info cache for port d819937e-c482-4d8c-85d3-10cd3f016c1b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:01.967199 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating instance_info_cache with network_info: [{"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:02.093914 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:35:02.094529 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:35:02.094800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:35:02.094888 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:35:02.095182 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:02.183037 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:02.227250 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:02.471375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-45f36939-d884-4971-8e3e-2f7ea609f0b3 req-bcf60bb6-36c1-48be-b2d9-fdc8b81e54cb service nova] Releasing lock "refresh_cache-61825815-2fef-44e5-bdb6-4f40ea7e49fe" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:02.841884 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9db57f7e-912f-44dc-a40d-acdbfd7d41cd req-fa03bd53-b78e-4e18-99f7-8be136912ba5 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-deleted-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:02.842874 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-9db57f7e-912f-44dc-a40d-acdbfd7d41cd req-fa03bd53-b78e-4e18-99f7-8be136912ba5 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Neutron deleted interface 5ea09587-45ea-4c3a-9c4d-d62f4a6dc453; detaching it from the instance and deleting it from the info cache
May 14 04:35:02.843361 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9db57f7e-912f-44dc-a40d-acdbfd7d41cd req-fa03bd53-b78e-4e18-99f7-8be136912ba5 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:03.022707 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:03.023064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] Acquiring lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:03.023283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:03.023416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:03.023690 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] No waiting events found dispatching network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:03.023808 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb6f685b-bb48-4745-b385-7b2a02f5ebd9 req-e6fd8694-6439-47c8-8d7d-2efea2b030e3 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Received event network-vif-unplugged-5ea09587-45ea-4c3a-9c4d-d62f4a6dc453 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:03.206090 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:03.232673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:03.350811 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9db57f7e-912f-44dc-a40d-acdbfd7d41cd req-fa03bd53-b78e-4e18-99f7-8be136912ba5 service nova] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Detach interface failed, port_id=5ea09587-45ea-4c3a-9c4d-d62f4a6dc453, reason: Instance 687170c3-d447-4e92-a5cc-979a86a38cd1 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:35:03.708128 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Took 1.61 seconds to deallocate network for instance.
May 14 04:35:04.217133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:04.220722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:04.357402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:04.357655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:04.358505 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Attaching volume 6a3663dc-5d12-403e-8163-889825359566 to /dev/vdb
May 14 04:35:04.403794 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:04.422184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:35:04.456811 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:04.506466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:35:04.506829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:35:04.519397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:35:04.522416 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:febb:4f6', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feeb:dd74', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:fee8:338a', 'fe80::90dc:4aff:fe30:df49'] 
May 14 04:35:04.522707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:35:04.529914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:35:04.530238 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:04.530662 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating existing volume attachment record: b8f9b972-7ba3-4b9d-8fc6-85df57375add {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:35:04.675404 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:04.675847 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:05.090909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:05.091494 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:05.091741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:05.092670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:05.093024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:05.110858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:05.110858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:05.110858 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:05.110858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:05.111197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:05.112006 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:05.130993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:05.130993 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:05.153691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:05.153691 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566] added
May 14 04:35:05.159941 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:05.159941 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0501(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:05.159941 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566] added
May 14 04:35:05.170562 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:05.170562 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0591(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:05.170562 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:05.182286 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:05.311069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:05.447119 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:05.447293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:05.707229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:05.763667 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Deleted allocations for instance 687170c3-d447-4e92-a5cc-979a86a38cd1
May 14 04:35:05.949662 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:35:06.160449 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:06.171068 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:06.177649 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:06.180274 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:06.180274 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:06.188689 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:06.188689 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.195435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.201871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.209142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.209142 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.209142 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.209142 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.209142 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:06.209400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.209400 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.209400 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.209400 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.209400 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:06.214249 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.214249 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.214249 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.214249 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.214249 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:06.214470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.214470 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.214470 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.214470 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.214470 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:06.244513 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.40.100,3260]
May 14 04:35:06.244513 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.40.100,3260] successful.
May 14 04:35:06.244513 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.257160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.258946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.50.100,3260]
May 14 04:35:06.258946 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.50.100,3260] successful.
May 14 04:35:06.258946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.273110 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:06.273451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:06.273606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:06.274542 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('11', '-', '-', 0) found on session 110 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:06.274709 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:06.275873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:06.296455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 110 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:06.296455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c078756-176f-4514-81e2-30d1f6f63d5a (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:06.303103 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:06.303490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:06.303490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:06.304547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] HCTL ('12', '-', '-', 0) found on session 111 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:06.304594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:06.332716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Searching for a device in session 111 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:06.332716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:06.506330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:06.506330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:06.511055 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:35:06.511236 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Claim successful on node np0000000747
May 14 04:35:06.573509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:06.771856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-debc8a04-caf9-456d-949b-969384268cfb tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "687170c3-d447-4e92-a5cc-979a86a38cd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.596s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:07.111263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:35:07.433008 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:07.845305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:07.845656 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:08.131983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found WWN 33000000032b23344 for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:08.132310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:08.132560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000032b23344', 'path': '/dev/dm-2', 'multipath_id': '33000000032b23344'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:08.132934 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000032b23344', 'path': '/dev/dm-2', 'multipath_id': '33000000032b23344'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:35:08.138178 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:08.348479 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:08.640310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Attempting to attach volume 6a3663dc-5d12-403e-8163-889825359566 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:35:08.642235 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:   <alias name="ua-6a3663dc-5d12-403e-8163-889825359566"/>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:   <serial>6a3663dc-5d12-403e-8163-889825359566</serial>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:08.642235 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:35:08.854974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.349s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:08.855302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:35:09.367987 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:35:09.367987 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:35:09.368180 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:09.368725 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:09.448935 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:35:09.871379 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:35:10.072052 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:10.072496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:10.110824 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Successfully created port: 5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:35:10.323306 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:10.323454 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:10.323625 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:10.323746 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] No VIF found with MAC fa:16:3e:bb:04:f6, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:10.376161 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:35:10.578311 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:35:10.635299 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00045860000000175205 future=<Future at 0x7436184f45f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:10.635993 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733295.6345506, d6c04f76-1f81-4921-ab27-3ff5b59b43b9 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:10.636245 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] VM Stopped (Lifecycle Event)
May 14 04:35:10.637243 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:10.637386 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.417943294999986 future=<Future at 0x7436184f4d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:10.637496 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.41782464500011 future=<Future at 0x7436184f4d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:10.693822 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Successfully updated port: 5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:35:10.768220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-changed-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:10.768220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Refreshing instance network info cache due to event network-changed-5f7c414d-4daa-4750-81d9-b91cc1c25a87. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:10.768220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] Acquiring lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:10.768220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] Acquired lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:10.768220 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Refreshing network info cache for port 5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:10.879950 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Booting with volume 1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 at /dev/vda
May 14 04:35:10.933186 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:10.946502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:35:10.972558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:11.035632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:35:11.036021 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:35:11.048969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:35:11.050331 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:febb:4f6', 'fe80::304f:95ff:fe1d:dc3f', 'fe80::fc16:3eff:feeb:dd74', 'fe80::f880:e3ff:fe10:cad', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:fee8:338a', 'fe80::90dc:4aff:fe30:df49'] 
May 14 04:35:11.050546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:35:11.050601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:35:11.050888 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:11.051117 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating existing volume attachment record: 2df7727c-d3be-4251-af82-a0257bff6fac {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:35:11.136899 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:11.137224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:11.139561 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: d6c04f76-1f81-4921-ab27-3ff5b59b43b9] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:11.142387 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:35:11.142578 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Claim successful on node np0000000747
May 14 04:35:11.177719 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:11.196861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:11.274040 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:11.340476 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:35:11.483020 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:11.575271 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:11.880349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-193bb8c9-83f0-408b-af24-a2acb16edd26 tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.523s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:11.985250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30db7f24-bae8-40e6-8b37-c95225d4c519 req-f9b91719-2e43-422e-b68e-b4ba03a098da service nova] Releasing lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:11.985944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:11.986189 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:35:12.328722 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:12.328944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:12.550158 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:12.550492 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:12.575983 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:35:12.737510 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:12.836700 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Detaching volume 6a3663dc-5d12-403e-8163-889825359566
May 14 04:35:12.905189 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Attempting to driver detach volume 6a3663dc-5d12-403e-8163-889825359566 from mountpoint /dev/vdb
May 14 04:35:12.918454 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-6a3663dc-5d12-403e-8163-889825359566 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:35:12.921682 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Found disk vdb by alias ua-6a3663dc-5d12-403e-8163-889825359566 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:35:12.921932 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Attempting to detach device vdb from instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:35:12.922394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <alias name="ua-6a3663dc-5d12-403e-8163-889825359566"/>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <serial>6a3663dc-5d12-403e-8163-889825359566</serial>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:12.922394 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:35:12.930556 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e from the persistent domain config.
May 14 04:35:12.930761 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] (1/8): Attempting to detach device vdb with device alias ua-6a3663dc-5d12-403e-8163-889825359566 from instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:35:12.931084 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <alias name="ua-6a3663dc-5d12-403e-8163-889825359566"/>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <serial>6a3663dc-5d12-403e-8163-889825359566</serial>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:12.931084 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:35:12.941572 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:13.053898 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:13.177931 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:35:13.178999 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:35:13.179255 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Creating image(s)
May 14 04:35:13.179579 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:35:13.179735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Ensure instance console log exists: /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:35:13.179979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:13.180120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:13.180232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:13.444171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:13.444652 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance network_info: |[{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:35:13.445376 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start _get_guest_xml network_info=[{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2df7727c-d3be-4251-af82-a0257bff6fac', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '31cf78b9-bf06-44b3-90ab-809461001d4e', 'attached_at': '', 'detached_at': '', 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'serial': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:35:13.449636 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:35:13.450039 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1211304667', uuid='31cf78b9-bf06-44b3-90ab-809461001d4e'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733313.4497023) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:35:13.453581 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:35:13.453581 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:35:13.454606 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:35:13.454846 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:35:13.455914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:35:13.456263 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:35:13.457086 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:35:13.457086 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:35:13.457086 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:35:13.457086 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:35:13.457086 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:35:13.457500 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:35:13.457500 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:35:13.457974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:35:13.457974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:35:13.457974 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:35:13.469893 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:13.470216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:13.470332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:13.470771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:13.470948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:13.485137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:13.485641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:13.486046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:13.486250 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:13.486627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:13.486799 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:13.500605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:13.500605 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:13.505130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:13.505130 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5] added
May 14 04:35:13.517675 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:13.517675 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:13.517675 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:13.517949 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:13.521060 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5] added
May 14 04:35:13.521060 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:13.521060 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:13.521060 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:13.521060 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:13.521060 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:13.521060 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:13.521283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:13.521422 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:13.521587 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:13.525121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733313.5248935, fb9eaac7-43db-4f85-9a60-5d8054da3c1e => ua-6a3663dc-5d12-403e-8163-889825359566> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:35:13.526264 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6a3663dc-5d12-403e-8163-889825359566 for instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:35:13.529133 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully detached device vdb from instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e from the live domain config.
May 14 04:35:13.530674 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:35:13.530967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:13.531096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:13.562260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.425s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:13.562721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:35:14.073911 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:35:14.077092 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:35:14.077565 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:14.077795 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:14.162948 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd917914b2414921963ae67e7a9780f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66752be38742a38c2a4ef876561d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:35:14.181101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:14.181372 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing instance network info cache due to event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:14.181470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:14.181531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:14.181731 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:14.518450 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:14.522044 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:14.535430 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:14.535430 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:14.544170 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:14.544170 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.555968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.564639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.573878 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:14.580781 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:35:14.585441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.585441 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.585441 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.585441 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.585441 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:14.585841 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.585841 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.585841 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.585841 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.585841 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:14.625083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260]
May 14 04:35:14.625083 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260] successful.
May 14 04:35:14.625083 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.638645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260]
May 14 04:35:14.638645 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260] successful.
May 14 04:35:14.638645 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.650200 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.660051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.680156 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.680353 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:14.680744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:14.680914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:14.681881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('9', '-', '-', 0) found on session 112 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:14.682044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:14.684113 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.689326 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:14.689662 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:14.689944 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:14.690036 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:14.691107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('10', '-', '-', 0) found on session 113 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:14.691260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:14.710175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 112 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:14.710175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:14.722946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 113 and hctl ['10', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:14.773487 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Successfully created port: 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:35:14.843275 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:14.843486 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing instance network info cache due to event network-changed-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:14.843898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] Acquiring lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:15.086598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:35:15.170206 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:15.345873 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updated VIF entry in instance network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:15.346229 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:15.416777 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Successfully updated port: 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:35:15.448245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:15.448514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:15.718194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 113 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:15.718194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:15.848396 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ec29578-4f06-4e39-a07e-5c8e6febee3f req-778a2cdb-1d18-4dcb-b608-f86afcd6a591 service nova] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:15.848890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] Acquired lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:15.849070 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Refreshing network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:15.919392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:15.919627 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:15.919836 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:35:15.951138 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Detaching volume a55bcb53-6677-467e-a440-3bd44265590e
May 14 04:35:15.993234 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Attempting to driver detach volume a55bcb53-6677-467e-a440-3bd44265590e from mountpoint /dev/vdb
May 14 04:35:16.002066 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found disk vdb by alias ua-a55bcb53-6677-467e-a440-3bd44265590e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:35:16.004557 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Found disk vdb by alias ua-a55bcb53-6677-467e-a440-3bd44265590e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:35:16.004824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Attempting to detach device vdb from instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:35:16.005254 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <alias name="ua-a55bcb53-6677-467e-a440-3bd44265590e"/>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <serial>a55bcb53-6677-467e-a440-3bd44265590e</serial>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:16.005254 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:35:16.019913 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully detached device vdb from instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 from the persistent domain config.
May 14 04:35:16.020078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] (1/8): Attempting to detach device vdb with device alias ua-a55bcb53-6677-467e-a440-3bd44265590e from instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:35:16.023648 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <alias name="ua-a55bcb53-6677-467e-a440-3bd44265590e"/>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <serial>a55bcb53-6677-467e-a440-3bd44265590e</serial>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:16.023648 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:35:16.056015 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00045878399987486773 future=<Future at 0x7436184f4d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:16.056273 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733301.0552642, 687170c3-d447-4e92-a5cc-979a86a38cd1 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:16.056435 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] VM Stopped (Lifecycle Event)
May 14 04:35:16.058861 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:16.098282 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:35:16.098282 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:35:16.098282 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating image(s)
May 14 04:35:16.098282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:16.098282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:16.098924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:16.099632 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:35:16.103056 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:35:16.105329 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:16.179122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:16.227103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:16.229676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:16.229676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:16.229676 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:35:16.232452 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:35:16.232948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:16.344430 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:16.347844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:16.367185 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:16.412522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk 1073741824" returned: 0 in 0.067s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:16.415638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:16.415638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:16.504312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 33000000095206e37 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:16.504876 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:16.505448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000095206e37', 'path': '/dev/dm-1', 'multipath_id': '33000000095206e37'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:16.506149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.975s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:16.506980 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000095206e37', 'path': '/dev/dm-1', 'multipath_id': '33000000095206e37'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:35:16.507166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a3663dc-5d12-403e-8163-889825359566', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:35:16.507406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:35:16.525153 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:35:16.531030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.117s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:16.532651 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:35:16.532651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.549798 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566 (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.550162 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:16.556496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:35:16.557056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', '110')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:16.559215 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566', '111')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:16.560673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436183880e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:35:16.564834 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 687170c3-d447-4e92-a5cc-979a86a38cd1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:16.565626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:35:16.566714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Flush multipath device 33000000032b23344 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:35:16.584100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:16.610401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:16.614960 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:16.615285 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:16.643005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:16.643894 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Cannot resize image /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:35:16.644454 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:35:16.644789 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Ensure instance console log exists: /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:35:16.645209 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:16.645595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:16.645955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:16.656978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:16.693477 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733316.6930118, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => ua-a55bcb53-6677-467e-a440-3bd44265590e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:35:16.696884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:35:16.696884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:35:16.697586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:35:16.701171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a55bcb53-6677-467e-a440-3bd44265590e for instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:35:16.705169 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully detached device vdb from instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 from the live domain config.
May 14 04:35:16.706572 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:35:16.707076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:16.707317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:16.717906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:35:16.718301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:35:16.731575 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.762157 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.40.100,3260]
May 14 04:35:16.762157 np0000000747 nova-compute[97971]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.40.100,3260] successful.
May 14 04:35:16.762157 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.785758 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.796429 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:16.799865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.815082 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:16.837594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.50.100,3260]
May 14 04:35:16.837594 np0000000747 nova-compute[97971]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-6a3663dc-5d12-403e-8163-889825359566, portal: 192.168.50.100,3260] successful.
May 14 04:35:16.837594 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.866565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:16.866947 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:16.867136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] <== disconnect_volume: return (3336ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:16.867305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:35:16.869211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:16.869538 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a55bcb53-6677-467e-a440-3bd44265590e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:35:16.869747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:35:16.899825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.899825 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.899825 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.899825 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.899825 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e (non-flash)
May 14 04:35:16.902547 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:35:16.902547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '99')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:16.908301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e', '98')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:16.909262 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618383c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:35:16.909524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:35:16.909862 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Flush multipath device 33000000016e0422b {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:35:16.946228 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:16.989560 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:16.991501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:17.022371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:35:17.022371 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:17.022371 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:17.022371 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:17.034782 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updated VIF entry in instance network info cache for port bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:17.034782 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [{"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:17.036289 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:35:17.036516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:35:17.038280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:35:17.054124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:35:17.054385 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:35:17.060971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-changed-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:17.063394 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing instance network info cache due to event network-changed-5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:17.063666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:17.066689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.116468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.40.100,3260]
May 14 04:35:17.116468 np0000000747 nova-compute[97971]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.40.100,3260] successful.
May 14 04:35:17.116468 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.135578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.149348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.176318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.50.100,3260]
May 14 04:35:17.176318 np0000000747 nova-compute[97971]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-a55bcb53-6677-467e-a440-3bd44265590e, portal: 192.168.50.100,3260] successful.
May 14 04:35:17.176318 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.189839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:17.190037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:17.190168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] <== disconnect_volume: return (482ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:17.190312 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:35:17.494792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:17.495088 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance network_info: |[{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:35:17.495451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:17.495451 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing network info cache for port 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:17.499067 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start _get_guest_xml network_info=[{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:35:17.502912 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:35:17.504638 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1774273441', uuid='3186131b-429e-4d79-9dc3-be4059f42fc2'), owner=OwnerMeta(userid='bd917914b2414921963ae67e7a9780f1', username='tempest-AttachVolumeShelveTestJSON-1339972729-project-member', projectid='4b66752be38742a38c2a4ef876561d9a', projectname='tempest-AttachVolumeShelveTestJSON-1339972729'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733317.5041971) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:35:17.507541 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:35:17.508956 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:35:17.512553 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:35:17.512903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:35:17.514184 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:35:17.514849 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:35:17.515186 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:35:17.515384 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:35:17.515650 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:35:17.518456 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <uuid>31cf78b9-bf06-44b3-90ab-809461001d4e</uuid>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <name>instance-00000035</name>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1211304667</nova:name>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:35:13</nova:creationTime>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         <nova:port uuid="5f7c414d-4daa-4750-81d9-b91cc1c25a87">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <system>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="serial">31cf78b9-bf06-44b3-90ab-809461001d4e</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="uuid">31cf78b9-bf06-44b3-90ab-809461001d4e</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </system>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <os>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </os>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <features>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </features>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   <devices>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <alias name="ua-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <serial>1daf23d7-cb21-4dfc-aa37-50b99a36a0a5</serial>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:35:f7:f3"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <target dev="tap5f7c414d-4d"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </interface>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/console.log" append="off"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </serial>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <video>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </video>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </rng>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:   </devices>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: </domain>
May 14 04:35:17.532916 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Preparing to wait for external event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:17.532916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:17.536851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:35:17.539944 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:17.541011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a6dd3bb7-8862-492a-87d6-b952e231e297 req-b1a99555-20d9-47e0-92b3-a770f3cb5237 service nova] Releasing lock "refresh_cache-eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:17.542403 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:17.542951 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:35:17.545355 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.546380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:17.546380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:35:17.550083 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFRFfjoV+j/OvoLwium9/rPSNaVA3/SiVgF6zoWfaNnT/MGeygiKGOxBHVj4AZvSTys3p1oKEmkSJdG1rqUDi3DX/4R6jkRlpCBkalPadCRULAfEjSlJ33NYyrixeH1NA==',key_name='tempest-keypair-653108543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:35:17.550355 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.550576 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '904c0cc6-0c10-5d81-8f28-560aa1f34c24', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:17.550868 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:17.551452 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:17.552555 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_devices' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:17.554639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:17.556334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.558461 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'flavor' on Instance uuid fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:17.562845 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.563369 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f7c414d-4d, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:17.563891 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f7c414d-4d, col_values=(('qos', UUID('a22ce180-009b-4aa3-9ade-c0729aad0cca')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:17.564130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f7c414d-4d, col_values=(('external_ids', {'iface-id': '5f7c414d-4daa-4750-81d9-b91cc1c25a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:f7:f3', 'vm-uuid': '31cf78b9-bf06-44b3-90ab-809461001d4e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:17.565176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.566779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:17.574472 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:17.576558 np0000000747 nova-compute[97971]: INFO os_vif [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d')
May 14 04:35:17.738533 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'flavor' on Instance uuid eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:18.000723 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:18.056710 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] End _get_guest_xml xml=<domain type="qemu">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <uuid>3186131b-429e-4d79-9dc3-be4059f42fc2</uuid>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <name>instance-00000036</name>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1774273441</nova:name>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:35:17</nova:creationTime>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:user uuid="bd917914b2414921963ae67e7a9780f1">tempest-AttachVolumeShelveTestJSON-1339972729-project-member</nova:user>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:project uuid="4b66752be38742a38c2a4ef876561d9a">tempest-AttachVolumeShelveTestJSON-1339972729</nova:project>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         <nova:port uuid="5138acaa-8641-40f4-8060-53339de07d09">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <system>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="serial">3186131b-429e-4d79-9dc3-be4059f42fc2</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="uuid">3186131b-429e-4d79-9dc3-be4059f42fc2</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </system>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <os>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </os>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <features>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </features>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   <devices>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:6f:37:11"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <target dev="tap5138acaa-86"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </interface>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/console.log" append="off"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </serial>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <video>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </video>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </rng>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:   </devices>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]: </domain>
May 14 04:35:18.056710 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Preparing to wait for external event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFRFfjoV+j/OvoLwium9/rPSNaVA3/SiVgF6zoWfaNnT/MGeygiKGOxBHVj4AZvSTys3p1oKEmkSJdG1rqUDi3DX/4R6jkRlpCBkalPadCRULAfEjSlJ33NYyrixeH1NA==',key_name='tempest-keypair-653108543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:18.061635 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:35:18.062152 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.062152 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:18.062152 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:35:18.062923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.063082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f688c75-2568-58ae-b7fd-75bb5dc7c293', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:18.063960 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.064783 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:18.071607 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.074010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.074197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5138acaa-86, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:18.074538 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5138acaa-86, col_values=(('qos', UUID('45e0710c-01ea-4be1-9279-e2ec25485cec')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:18.074717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5138acaa-86, col_values=(('external_ids', {'iface-id': '5138acaa-8641-40f4-8060-53339de07d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:37:11', 'vm-uuid': '3186131b-429e-4d79-9dc3-be4059f42fc2'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:18.075462 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.076815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:18.086852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:18.088289 np0000000747 nova-compute[97971]: INFO os_vif [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86')
May 14 04:35:18.399403 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:18.574435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d490c5db-b19e-47fa-add8-1f284854c75d tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.245s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:18.599970 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updated VIF entry in instance network info cache for port 5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:18.600658 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:18.610009 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:18.610891 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:18.746677 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7974cc38-f69e-48f4-b953-180c17a079b9 tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.298s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:18.792791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:18.793083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:18.793347 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:18.793637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:18.793827 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:18.797272 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Terminating instance
May 14 04:35:19.106652 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8de6d6b3-6bd9-4d5a-86f3-9fe2857f5bee req-368ceeef-7bf1-46c5-8f42-d9fdb61fc137 service nova] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:19.109963 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:19.109963 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:19.109963 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:35:f7:f3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:19.109963 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Using config drive
May 14 04:35:19.300275 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:35:19.336653 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:19.360790 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:19.362270 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:19.399709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] No waiting events found dispatching network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:19.521638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f5f00e-bbcd-4101-bb35-96857056636d req-1a9037e3-edb7-4234-9fc1-5bf05e1fa567 service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:19.617646 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:19.620652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:19.629078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:19.629234 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:19.629357 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No VIF found with MAC fa:16:3e:6f:37:11, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:19.629835 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Using config drive
May 14 04:35:19.646568 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999658404000002 future=<Future at 0x74361826f1a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:19.647122 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99908461699988 future=<Future at 0x74361826f1a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:19.647324 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998876027999813 future=<Future at 0x74361826f1a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:19.649564 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Instance destroyed successfully.
May 14 04:35:19.650095 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lazy-loading 'resources' on Instance uuid fb9eaac7-43db-4f85-9a60-5d8054da3c1e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:19.784579 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Creating config drive at /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config
May 14 04:35:19.789168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mnjmmcn {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:19.848908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mnjmmcn" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:20.140333 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:20.155463 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1855610778',display_name='tempest-AttachVolumeNegativeTest-server-1855610778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumenegativetest-server-1855610778',id=50,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB5ddrMOIQe7bcjDQO/0puSo6ssgpqdLVND36pLr9MwcNd6bDVJQKcypKzMfV2rUTs8k1vx3yz/f0HpxU/+2hQtN6DhLTwXMb8pdeqHvIL30zgmA57h6zExWsXsR0KjYw==',key_name='tempest-keypair-2116521874',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1481ce79a54b72a2f83aa185ea46d1',ramdisk_id='',reservation_id='r-g1s3akpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2053621712',owner_user_name='tempest-AttachVolumeNegativeTest-2053621712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d28aa2d5d8d4d42931857f8b63ad188',uuid=fb9eaac7-43db-4f85-9a60-5d8054da3c1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:35:20.155463 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converting VIF {"id": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "address": "fa:16:3e:bb:04:f6", "network": {"id": "1eb00828-e8fb-468c-805a-30c6c1027e47", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1678040196-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e1481ce79a54b72a2f83aa185ea46d1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap724c3b33-11", "ovs_interfaceid": "724c3b33-11f8-4ba6-84f0-9e77ac5a4d05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:20.155463 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:20.155463 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:35:20.158505 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.158834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap724c3b33-11, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:20.160047 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.160950 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:20.173050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.175148 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.175503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=752e971b-9130-411e-ba4d-2211bc9a74f7) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:20.176103 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.176759 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:20.187882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.193642 np0000000747 nova-compute[97971]: INFO os_vif [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:04:f6,bridge_name='br-int',has_traffic_filtering=True,id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05,network=Network(1eb00828-e8fb-468c-805a-30c6c1027e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap724c3b33-11')
May 14 04:35:20.193642 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Deleting instance files /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e_del
May 14 04:35:20.193642 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Deletion of /opt/stack/data/nova/instances/fb9eaac7-43db-4f85-9a60-5d8054da3c1e_del complete
May 14 04:35:20.315066 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.325748 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating config drive at /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config
May 14 04:35:20.333232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp65g6lsuc {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:20.356206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.411641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp65g6lsuc" returned: 0 in 0.076s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:20.459187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.602586 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:20.606148 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:20.619230 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fb64e06-1c77-4f44-a982-d1309c6577fa req-e4ee0d14-ec06-4223-825e-1b159a7a7550 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:20.619653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb64e06-1c77-4f44-a982-d1309c6577fa req-e4ee0d14-ec06-4223-825e-1b159a7a7550 service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:20.620060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb64e06-1c77-4f44-a982-d1309c6577fa req-e4ee0d14-ec06-4223-825e-1b159a7a7550 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:20.620342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1fb64e06-1c77-4f44-a982-d1309c6577fa req-e4ee0d14-ec06-4223-825e-1b159a7a7550 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:20.620608 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1fb64e06-1c77-4f44-a982-d1309c6577fa req-e4ee0d14-ec06-4223-825e-1b159a7a7550 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Processing event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:35:20.700640 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:35:20.701607 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:35:20.701991 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:35:20.702153 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:35:20.702663 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:20.721914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.727976 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.733675 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.756480 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.766485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:20.879325 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:21.002749 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.012420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:21.012420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:21.013321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:21.013321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:21.013856 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:21.025390 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Terminating instance
May 14 04:35:21.037824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.161386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.179971 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.419284 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.425111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.452906 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.456161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.531667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:35:21.546804 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2494c083-942c-4f33-b250-774198485a8b req-17950d5c-6929-46b6-ab40-452cf142478d service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-deleted-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:21.547414 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-2494c083-942c-4f33-b250-774198485a8b req-17950d5c-6929-46b6-ab40-452cf142478d service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Neutron deleted interface 724c3b33-11f8-4ba6-84f0-9e77ac5a4d05; detaching it from the instance and deleting it from the info cache
May 14 04:35:21.547681 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2494c083-942c-4f33-b250-774198485a8b req-17950d5c-6929-46b6-ab40-452cf142478d service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:21.559285 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.562087 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.585835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.602741 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.611488 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:21.611488 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:21.624981 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:21.625385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Acquiring lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:21.625754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:21.626210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:21.626210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] No waiting events found dispatching network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:21.626210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Received event network-vif-unplugged-724c3b33-11f8-4ba6-84f0-9e77ac5a4d05 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:21.626210 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:21.626574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:21.626762 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:21.626862 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:21.626972 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Processing event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:35:21.627122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:21.627260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:21.627381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:21.627546 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:21.627606 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:21.627787 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f8309b2a-29f7-4ac8-9099-f97bd6048619 req-e0a20e37-b709-4a12-b238-66269c1b6dea service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received unexpected event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with vm_state building and task_state spawning.
May 14 04:35:21.631416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:21.807139 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733321.8066847, 31cf78b9-bf06-44b3-90ab-809461001d4e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:21.807340 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Started (Lifecycle Event)
May 14 04:35:21.811631 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:35:21.815021 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:35:21.819215 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance spawned successfully.
May 14 04:35:21.819737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:35:21.897665 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Instance destroyed successfully.
May 14 04:35:21.898218 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lazy-loading 'resources' on Instance uuid eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:21.990073 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:22.054178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2494c083-942c-4f33-b250-774198485a8b req-17950d5c-6929-46b6-ab40-452cf142478d service nova] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Detach interface failed, port_id=724c3b33-11f8-4ba6-84f0-9e77ac5a4d05, reason: Instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:35:22.169478 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:35:22.173221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:35:22.177909 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance spawned successfully.
May 14 04:35:22.178650 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:35:22.313721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:22.318438 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:22.327847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.328123 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.328461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.328781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.329104 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.329417 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.404343 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-964923410',display_name='tempest-TestMinimumBasicScenario-server-964923410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testminimumbasicscenario-server-964923410',id=47,image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2Gw3kDzWhR6/v107eHSiG0XsjebHh9kctWgdIkta8daqNXdTbW1KnDMtXDbXFHEhlFznvXJQnkCUpWjmQ1num5gKvnT7h/a+fyIYz3/tanWMHS0IoMSkrrU9DgVf/PPg==',key_name='tempest-TestMinimumBasicScenario-72143506',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:33:51Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6495e941aabb4280afd6c384a250e6dd',ramdisk_id='',reservation_id='r-30m4y50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3f41b31-48f4-42f0-ac45-2bf97acd4dbe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-482942579',owner_user_name='tempest-TestMinimumBasicScenario-482942579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:34:36Z,user_data=None,user_id='5673930adce14c6ea2b647e1a339636b',uuid=eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:35:22.406197 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converting VIF {"id": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "address": "fa:16:3e:eb:dd:74", "network": {"id": "10cc04b1-df81-4898-afc8-1b90b454e1c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-486238186-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6495e941aabb4280afd6c384a250e6dd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c2b58-ea", "ovs_interfaceid": "bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:22.408181 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:22.409200 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:35:22.410670 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:22.410944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc0c2b58-ea, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:22.419599 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:22.420963 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:22.422592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:22.422592 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4e0854d-1e1d-4feb-9af3-1559aedcfe3b) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:22.422871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:22.423302 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:22.424874 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:22.428586 np0000000747 nova-compute[97971]: INFO os_vif [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:dd:74,bridge_name='br-int',has_traffic_filtering=True,id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b,network=Network(10cc04b1-df81-4898-afc8-1b90b454e1c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c2b58-ea')
May 14 04:35:22.429649 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Deleting instance files /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0_del
May 14 04:35:22.430657 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Deletion of /opt/stack/data/nova/instances/eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0_del complete
May 14 04:35:22.494965 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Took 1.79 seconds to deallocate network for instance.
May 14 04:35:22.610039 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:22.610354 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:22.689369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.689768 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.690303 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.690785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.691214 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.691685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:35:22.702276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:22.702930 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:22.703216 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:22.703450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:22.703706 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:22.704182 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-57c95e69-2fc1-497f-96ac-d40c532fc146 req-465bbcc5-32c6-4f64-b0a6-6475ba499e6d service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received unexpected event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with vm_state building and task_state spawning.
May 14 04:35:22.823278 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:35:22.823560 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733322.8233662, 31cf78b9-bf06-44b3-90ab-809461001d4e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:22.823695 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Paused (Lifecycle Event)
May 14 04:35:22.840020 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Took 9.66 seconds to spawn the instance on the hypervisor.
May 14 04:35:22.840020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:22.941110 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 14 04:35:22.941806 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:35:22.942239 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:35:22.942323 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:35:22.942542 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:23.009591 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:23.009591 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:23.029705 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:23.116643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:23.199528 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Took 7.10 seconds to spawn the instance on the hypervisor.
May 14 04:35:23.199724 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:23.331338 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:23.337541 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733323.3372014, 31cf78b9-bf06-44b3-90ab-809461001d4e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:23.337682 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Resumed (Lifecycle Event)
May 14 04:35:23.352206 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Took 16.90 seconds to build instance.
May 14 04:35:23.513463 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:23.513934 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:23.636290 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:23.637308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:23.637702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:23.637702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:23.637873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:23.638052 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:23.638147 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:23.638295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Acquiring lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:23.638472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:23.638647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:23.638755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] No waiting events found dispatching network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:23.638886 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be5eb82b-9680-4f9c-b51b-5499bc44a2d1 req-9789af90-b43c-4a30-8199-87c51aa72cfc service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-unplugged-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:35:23.704167 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-120471dd-dc84-46a8-8290-3e853eb9ddea req-23b9ae48-e0bf-4377-951f-840fc68480da service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Received event network-vif-deleted-bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:23.704554 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-120471dd-dc84-46a8-8290-3e853eb9ddea req-23b9ae48-e0bf-4377-951f-840fc68480da service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Neutron deleted interface bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b; detaching it from the instance and deleting it from the info cache
May 14 04:35:23.704688 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-120471dd-dc84-46a8-8290-3e853eb9ddea req-23b9ae48-e0bf-4377-951f-840fc68480da service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:23.716144 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Took 12.63 seconds to build instance.
May 14 04:35:23.840971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:23.843044 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:23.856165 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.409s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:23.871441 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:24.019018 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:24.209485 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-120471dd-dc84-46a8-8290-3e853eb9ddea req-23b9ae48-e0bf-4377-951f-840fc68480da service nova] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Detach interface failed, port_id=bc0c2b58-eaf9-4c2c-b2ce-8ea7ccb9289b, reason: Instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:35:24.218517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.146s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:24.346585 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999740566999662 future=<Future at 0x7435f8475d30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:24.346700 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733324.346548, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:24.346811 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Started (Lifecycle Event)
May 14 04:35:24.374214 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Took 1.43 seconds to deallocate network for instance.
May 14 04:35:24.529287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.521s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:24.532393 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.414s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:24.535958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.006s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:24.536100 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:35:24.620750 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Deleted allocations for instance fb9eaac7-43db-4f85-9a60-5d8054da3c1e
May 14 04:35:24.850100 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:24.851944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:24.879926 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:24.880112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:25.233884 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:25.234204 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:25.354790 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733325.3543117, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:25.354923 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Paused (Lifecycle Event)
May 14 04:35:25.567693 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:25.635711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-18d6a733-0ed6-4f11-8b13-871a889bd62f tempest-AttachVolumeNegativeTest-2053621712 tempest-AttachVolumeNegativeTest-2053621712-project-member] Lock "fb9eaac7-43db-4f85-9a60-5d8054da3c1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.842s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:25.681310 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:25.682444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:25.724706 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-changed-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:25.724901 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing instance network info cache due to event network-changed-5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:25.726001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:25.726133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:25.726326 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing network info cache for port 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:25.740179 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:25.799947 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:25.805221 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-changed-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:25.805420 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Refreshing instance network info cache due to event network-changed-5f7c414d-4daa-4750-81d9-b91cc1c25a87. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:25.805686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] Acquiring lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:25.805868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] Acquired lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:25.805971 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Refreshing network info cache for port 5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:25.809496 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:35:25.815705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:25.859509 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:25.865528 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733325.8648434, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:25.865688 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Resumed (Lifecycle Event)
May 14 04:35:25.926735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:25.928166 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:26.030732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:26.034880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:26.134593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:26.136125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:26.184684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:26.230528 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:26.252282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.372s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:26.256296 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:26.269467 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:35:26.271645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:26.318678 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:26.344881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:26.345377 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13007MB free_disk=72.88418960571289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:35:26.345634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:26.345980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:26.361119 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Deleted allocations for instance eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0
May 14 04:35:26.371341 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:26.377610 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:26.711526 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:26.726418 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:26.792825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:26.793807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:26.886717 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updated VIF entry in instance network info cache for port 5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:26.887200 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:26.923945 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updated VIF entry in instance network info cache for port 5f7c414d-4daa-4750-81d9-b91cc1c25a87. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:26.924215 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:27.297900 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:27.372112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7b34c4b7-a246-4f53-a053-6b4d57b44a7a tempest-TestMinimumBasicScenario-482942579 tempest-TestMinimumBasicScenario-482942579-project-member] Lock "eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.360s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:27.392642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a05ac873-0b14-46c7-8a03-655433ae3ee5 req-6a3f668b-ec35-4983-b259-4db8a5603c37 service nova] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:27.412980 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:35:27.414644 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:35:27.414644 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 31cf78b9-bf06-44b3-90ab-809461001d4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:35:27.414644 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3186131b-429e-4d79-9dc3-be4059f42fc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:35:27.414644 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:35:27.414644 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:35:26 up 35 min,  2 users,  load average: 9.08, 8.60, 5.29\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_7c56a1dd0473425da8eddafc3d4c27a7': '1', 'io_workload': '0', 'num_proj_ffc8341628a343b88c90dd7e5d8e5427': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'num_proj_4b66752be38742a38c2a4ef876561d9a': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:35:27.427196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c9d948c7-e208-40ab-8d38-a9a1070d85c0 req-fbe7eb49-c2e5-439a-adba-430ce61c37a0 service nova] Releasing lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:27.433579 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:27.663396 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:27.663688 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:28.166886 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:28.304061 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:28.677636 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:35:28.677823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.332s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:28.678213 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:29.373787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:29.374315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:29.374315 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attaching volume 588ad83b-dc6b-492e-8d75-0479630960ba to /dev/vdb
May 14 04:35:29.428898 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:29.442448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:35:29.467345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:29.530434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:35:29.530434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:35:29.540473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:35:29.542170 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:fee8:338a', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe35:f7f3', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe6f:3711', 'fe80::74de:beff:fe87:e3c8'] 
May 14 04:35:29.542307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:35:29.542459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:35:29.542657 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:29.542888 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating existing volume attachment record: 6b4830dc-1bc6-41c4-b1a9-2205a9bf463a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:35:29.966257 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:30.108590 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:30.109430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:30.109430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:30.110044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:30.110214 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:30.128184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:30.129284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:30.130035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:30.131474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:30.131745 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:30.132417 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:30.144999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:30.144999 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:30.154329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:30.154329 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:30.165119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba] added
May 14 04:35:30.165119 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:30.165119 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:30.165119 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:30.165119 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:30.165119 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:30.165119 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:30.165480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:30.165584 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:30.165919 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba] added
May 14 04:35:30.173934 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:30.173934 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:30.173934 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:31.166487 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:31.176750 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:31.187874 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:31.187874 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.191731 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:31.199751 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:31.199751 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.209090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.218744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.226766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.226766 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.226766 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:31.226909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.226909 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.226909 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:31.240660 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.240660 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.240660 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:31.240830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.240830 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.240830 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:31.287260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260]
May 14 04:35:31.287260 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260] successful.
May 14 04:35:31.287260 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.309261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:31.323118 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.323118 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.323118 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:31.323118 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:31.323300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.323300 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:31.323300 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:31.323300 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:31.323652 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:31.323838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:31.324460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('7', '-', '-', 0) found on session 116 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:31.324583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:31.344496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 116 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:31.344496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:31.678271 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:31.678872 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:35:31.679016 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:35:31.679534 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.93 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:35:31.949027 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:32.302701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260]
May 14 04:35:32.302701 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260] successful.
May 14 04:35:32.302701 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:32.319106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:32.320571 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:32.342463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:32.342463 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:32.342463 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:32.342463 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:32.342463 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:32.342694 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:32.342694 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:32.342694 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:32.342694 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:32.342694 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:32.342950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.213s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:32.343069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:32.344255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('8', '-', '-', 0) found on session 117 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:32.344255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:32.370043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 117 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:32.372280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:32.433077 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:33.168827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:35:34.188767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799093 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:34.188767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.078s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:34.188767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== connect_volume: return (4078ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799093', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799093'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:34.188767 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799093', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799093'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:35:34.195131 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:34.646698 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004421260000526672 future=<Future at 0x74361826f1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:34.647360 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733319.6461146, fb9eaac7-43db-4f85-9a60-5d8054da3c1e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:34.647360 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:34.647521 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] VM Stopped (Lifecycle Event)
May 14 04:35:34.649095 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.697736222999993 future=<Future at 0x7435f8475d30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:34.649095 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.697532102999958 future=<Future at 0x7435f8475d30 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:34.699289 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attempting to attach volume 588ad83b-dc6b-492e-8d75-0479630960ba with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:35:34.701335 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:   <alias name="ua-588ad83b-dc6b-492e-8d75-0479630960ba"/>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:   <serial>588ad83b-dc6b-492e-8d75-0479630960ba</serial>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:34.701335 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:35:35.150088 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dcfe98c6-ca8b-4bbe-af96-d2dfe7f07c9d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: fb9eaac7-43db-4f85-9a60-5d8054da3c1e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:36.190384 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:36.396521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:36.398645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:36.398645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:36.398645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:9c:de:75, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:36.778122 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:36.778510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:37.150668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:37.281821 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:37.444742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:37.785168 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Ignoring supplied device name: /dev/vdb
May 14 04:35:37.969211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9b33747f-ce26-4689-9782-24ee400357ce tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.595s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:38.288530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:38.325086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:38.325259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:38.325425 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:38.327695 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97971) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 04:35:38.328215 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:39.003842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.346863 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005884900001547066 future=<Future at 0x7435f8475d30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:39.347271 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:39.347731 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733324.346171, eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:39.347731 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] VM Stopped (Lifecycle Event)
May 14 04:35:39.358473 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.363521 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.379958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:39.380259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:39.380774 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Attaching volume 920720a7-ab77-4d52-b515-94272c01e525 to /dev/vdb
May 14 04:35:39.386252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.389159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.425123 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:39.462784 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:39.481392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:35:39.512724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:39.573249 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:39.577447 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:39.578311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:39.578511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:39.578777 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:39.578987 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6c6534f2-e2e4-46fd-8bd1-e9cd8768d977 req-5612c2f8-4afb-4542-b575-92d05e1a688b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state active and task_state powering-off.
May 14 04:35:39.579645 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:35:39.580404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:35:39.593489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:35:39.593489 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fee8:338a', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe35:f7f3', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe6f:3711', 'fe80::74de:beff:fe87:e3c8'] 
May 14 04:35:39.593489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:35:39.593489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:35:39.593489 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:39.594211 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating existing volume attachment record: 7d1fd663-7de3-40f7-9de3-f341ba980a0d {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:35:39.716793 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999621155000114 future=<Future at 0x7435f8391bb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:39.718121 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance destroyed successfully.
May 14 04:35:39.720188 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.995632946000114 future=<Future at 0x7435f8391bb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:39.720188 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.995336424000016 future=<Future at 0x7435f8391bb0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:39.720789 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'numa_topology' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:39.850845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: eaa8bec4-3beb-4b7a-93b9-f7e0dab762f0] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:40.174109 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:40.174584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:40.174785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:40.176160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:40.176160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:40.192042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:40.195198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:40.195198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:40.195198 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:40.195198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:40.197583 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:40.210660 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:40.210660 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:40.216530 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:40.216530 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:40.223734 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:40.224461 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525] added
May 14 04:35:40.231056 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:40.231056 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:40.231056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:40.231440 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:40.231699 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525] added
May 14 04:35:40.234645 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:40.234645 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:40.234645 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:40.661914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:40.735768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-715d4171-5c93-49c0-9a2f-b6081be7e712 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.410s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:41.192250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:41.232315 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:41.234104 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:41.251329 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:41.251329 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:41.256090 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:41.256090 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.273892 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.288686 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.298688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.298688 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.298688 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.298688 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.298688 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:41.298954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.298954 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.298954 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.298954 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.298954 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:41.311140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.311140 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.311140 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.311140 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.311140 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:41.311492 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.311492 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.311492 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.311492 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.311492 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:41.338230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.40.100,3260]
May 14 04:35:41.338230 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.40.100,3260] successful.
May 14 04:35:41.338230 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.339407 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:41.357180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.369596 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.50.100,3260]
May 14 04:35:41.369596 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.50.100,3260] successful.
May 14 04:35:41.369596 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.379072 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.379321 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:41.380361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:41.380361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:41.383815 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] HCTL ('11', '-', '-', 0) found on session 118 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:41.384114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:41.392012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:41.415896 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 118 and hctl ['11', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.418188 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:41.418439 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:41.418673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:41.418858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:41.419768 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] HCTL ('12', '-', '-', 0) found on session 119 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:41.419938 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:41.454515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 119 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:41.454780 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:41.667392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:41.667779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:41.667862 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:41.668401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:41.668401 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:41.668401 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-4c8f6f93-d4b1-4d0e-9ad6-f0a3b0c18727 req-5fd1f050-7fc5-4a80-bc44-1c0454968360 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state stopped and task_state powering-on.
May 14 04:35:41.846256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:41.846422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquired lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:41.846593 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:35:41.846822 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'info_cache' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:42.350382 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:42.410230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Searching for a device in session 118 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:42.410328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:42.447596 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:42.852954 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:43.012303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:43.213429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found WWN 330000000704119b0 for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:43.213800 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:43.214009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000704119b0', 'path': '/dev/dm-2', 'multipath_id': '330000000704119b0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:43.214374 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000704119b0', 'path': '/dev/dm-2', 'multipath_id': '330000000704119b0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:35:43.228140 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:43.325222 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:43.493464 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:43.733098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Attempting to attach volume 920720a7-ab77-4d52-b515-94272c01e525 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:35:43.734832 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:   <alias name="ua-920720a7-ab77-4d52-b515-94272c01e525"/>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:   <serial>920720a7-ab77-4d52-b515-94272c01e525</serial>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]: </disk>
May 14 04:35:43.734832 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:35:43.996688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Releasing lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:44.737569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:45.011457 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance destroyed successfully.
May 14 04:35:45.011925 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'numa_topology' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:45.408460 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:45.408595 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:45.408733 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:45.408869 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] No VIF found with MAC fa:16:3e:e8:33:8a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:45.513902 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:45.514344 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'resources' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:46.016490 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:46.017082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:35:46.017290 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:46.017980 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:46.018224 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:35:46.020263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.020561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2769404f-a1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:46.023081 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.024187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:46.024940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.025085 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93adbc56-9c67-4a89-afd7-16cd7664592f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:46.025917 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.026497 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:46.029799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.032150 np0000000747 nova-compute[97971]: INFO os_vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:35:46.036149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:46.066366 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:46.066600 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:46.066830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:35:46.066939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '116')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:46.067858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '117')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:35:46.068799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f845a5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:35:46.068969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:35:46.069189 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flush multipath device 330000000bbfbb071 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:35:46.114046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:46.159967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:35:46.196861 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:46.205338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:35:46.205716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:35:46.206970 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:35:46.221773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:35:46.222086 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:35:46.238058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.269240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260]
May 14 04:35:46.269240 np0000000747 nova-compute[97971]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260] successful.
May 14 04:35:46.269240 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.288889 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.300859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.341435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260]
May 14 04:35:46.341435 np0000000747 nova-compute[97971]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260] successful.
May 14 04:35:46.341435 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.358035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:46.359419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:46.359419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== disconnect_volume: return (323ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:46.359419 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:35:46.364241 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start _get_guest_xml network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6b4830dc-1bc6-41c4-b1a9-2205a9bf463a', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'ea107286-2cae-47ed-a3ee-a3ad8bf15ae8', 'attached_at': '', 'detached_at': '', 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'serial': '588ad83b-dc6b-492e-8d75-0479630960ba'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:35:46.366724 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:35:46.367922 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-655844742', uuid='ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'), owner=OwnerMeta(userid='a74e809c82bf46ce93759af89887f6b7', username='tempest-AttachVolumeTestJSON-948226058-project-member', projectid='7c56a1dd0473425da8eddafc3d4c27a7', projectname='tempest-AttachVolumeTestJSON-948226058'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733346.3676054) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:35:46.369445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:35:46.369852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:35:46.371203 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:35:46.371490 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:35:46.372568 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:35:46.374155 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:35:46.374790 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:35:46.374790 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:35:46.374790 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:46.876785 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:46.888792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:46.967502 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9751dac-1ec9-4064-9e8a-0ab84cfff381 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.587s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:46.984306 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:46.984943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:46.985208 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:46.986203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:46.986631 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:46.987126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:46.987273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:46.987639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:46.987961 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:47.000475 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:47.001212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:47.001722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:47.001977 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:47.002666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:47.002666 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:47.014419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:47.014419 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:47.019108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:47.019108 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:47.025984 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba] added
May 14 04:35:47.025984 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:47.025984 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:47.025984 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:47.025984 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:47.025984 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:47.025984 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:47.026286 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:47.027097 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:47.027097 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:47.031525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba] added
May 14 04:35:47.031525 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:47.031525 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:47.031525 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:47.031525 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:47.031525 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:47.031525 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:47.031749 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:47.031877 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:47.032002 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:48.027107 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:48.032490 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:48.041407 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:48.041407 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:48.052225 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:48.052225 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.057547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.067925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.072129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.072129 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.072129 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.072129 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.072129 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:48.072534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.072534 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.072534 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.072534 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.072534 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.085016 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:48.116445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260]
May 14 04:35:48.116445 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260] successful.
May 14 04:35:48.116445 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.132219 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.139275 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260]
May 14 04:35:48.139275 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260] successful.
May 14 04:35:48.139275 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.150042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.150656 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.150881 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:48.151122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:48.151206 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:48.152099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('7', '-', '-', 0) found on session 120 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:48.152217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:48.167049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 120 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:48.167049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.173797 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:48.174011 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:48.174303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:48.174463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:48.175349 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('8', '-', '-', 0) found on session 121 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:48.175507 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:48.193904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 121 and hctl ['8', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:49.135500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:49.135933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:49.192034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 121 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:49.193316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:49.637711 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:35:50.018755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found WWN 330000000bbfbb071 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:50.022291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:50.022291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000bbfbb071', 'path': '/dev/dm-0', 'multipath_id': '330000000bbfbb071'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:50.022291 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbfbb071', 'path': '/dev/dm-0', 'multipath_id': '330000000bbfbb071'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:35:50.185118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:50.185535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:50.188636 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:35:50.188853 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Claim successful on node np0000000747
May 14 04:35:50.527752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:35:50.530220 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:50.530220 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:50.530220 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'pci_devices' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:51.026527 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:51.033637 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:51.033637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] End _get_guest_xml xml=<domain type="qemu">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <uuid>ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</uuid>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <name>instance-00000033</name>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeTestJSON-server-655844742</nova:name>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:35:46</nova:creationTime>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:user uuid="a74e809c82bf46ce93759af89887f6b7">tempest-AttachVolumeTestJSON-948226058-project-member</nova:user>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:project uuid="7c56a1dd0473425da8eddafc3d4c27a7">tempest-AttachVolumeTestJSON-948226058</nova:project>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         <nova:port uuid="2769404f-a1f4-440a-97f5-692848a35083">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <system>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="serial">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="uuid">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </system>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <os>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </os>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <features>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </features>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   <devices>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <alias name="ua-588ad83b-dc6b-492e-8d75-0479630960ba"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <serial>588ad83b-dc6b-492e-8d75-0479630960ba</serial>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </disk>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:de:75"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <target dev="tap2769404f-a1"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </interface>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/console.log" append="off"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </serial>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <video>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </video>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </rng>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:   </devices>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]: </domain>
May 14 04:35:51.033637 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:35:51.033637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:51.133741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:51.137474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:51.202145 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:51.259040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:51.259504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:35:51.260899 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:51.478824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:35:51.479088 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:35:51.768959 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:51.769205 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:51.869241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:51.869711 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:35:51.869962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:51.979550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:35:51.980007 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Cannot resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:35:51.980303 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'migration_context' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:35:51.983374 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:35:52.490182 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:35:52.491259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:35:52.491464 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:35:52.492122 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:35:52.492378 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:35:52.492910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.493321 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:52.493725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:35:52.494499 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.494704 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8293de9c-b3f9-53a5-9134-c2c6844b1cdb', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:52.496772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:52.497238 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.498535 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:35:52.501018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:52.503884 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.504087 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2769404f-a1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:52.504538 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2769404f-a1, col_values=(('qos', UUID('b10fdb93-9d41-47c2-b9ba-3323d32e70e5')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:52.504772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2769404f-a1, col_values=(('external_ids', {'iface-id': '2769404f-a1f4-440a-97f5-692848a35083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:de:75', 'vm-uuid': 'ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:35:52.505769 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.507272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:35:52.512709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:52.514437 np0000000747 nova-compute[97971]: INFO os_vif [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:35:52.990188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.010242 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:35:53.010242 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:35:53.010419 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:53.010701 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:53.024469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.028338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.107332 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdf7a94492f3476fb201e51478145d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582a6b9df4fc4204ba57f289f810d031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:35:53.127332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.201106 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:53.201359 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:53.201574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:53.201747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:53.201888 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:53.202156 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-08782f40-b6a6-41df-b2b3-e8adee4485c6 req-8dfd2925-9732-4740-a778-7c29e859f44a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state stopped and task_state powering-on.
May 14 04:35:53.358421 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.365743 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.390572 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:53.515765 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:35:53.775219 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Successfully created port: 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:35:54.017879 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 due to new event <LifecycleEvent: 1778733354.0171254, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:35:54.017879 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733354.0171254, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:54.018095 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Resumed (Lifecycle Event)
May 14 04:35:54.021938 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:35:54.029073 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:35:54.033371 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance rebooted successfully.
May 14 04:35:54.488146 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Successfully updated port: 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:35:54.522433 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:54.530138 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:54.535768 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Booting with volume 3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 at /dev/vda
May 14 04:35:54.604399 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:54.623891 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:35:54.654558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:35:54.718106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:35:54.719880 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.003426717999900575 future=<Future at 0x7435f8391bb0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:54.719880 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:35:54.719880 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:35:54.730663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:35:54.732881 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fee8:338a', 'fe80::90dc:4aff:fe30:df49', 'fe80::fc16:3eff:fe35:f7f3', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe6f:3711', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181'] 
May 14 04:35:54.733204 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:35:54.733519 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:35:54.733877 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:54.734307 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating existing volume attachment record: c5b10a07-4a3d-428c-b092-4d5061a56354 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:35:54.990768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:54.990920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:54.991033 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:35:55.033148 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:35:55.033636 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733355.0334036, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:35:55.033797 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Started (Lifecycle Event)
May 14 04:35:55.281053 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:55.281565 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:55.281960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:55.282103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:55.282275 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:35:55.282463 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state stopped and task_state powering-on.
May 14 04:35:55.282632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:35:55.282845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing instance network info cache due to event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:35:55.282996 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:35:55.536935 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:55.541060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:35:55.552059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:55.552223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:55.552365 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:35:55.552512 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:9c:de:75, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:35:55.553018 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-31445208-ae75-4491-8708-1bd0eab13f53 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:35:55.609503 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:35:55.816535 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:56.009168 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:56.044701 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:35:56.200524 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:56.511741 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:56.512151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance network_info: |[{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:35:56.513023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:35:56.513264 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:35:56.890741 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:35:56.892043 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:35:56.892316 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating image(s)
May 14 04:35:56.893129 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:35:56.893305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Ensure instance console log exists: /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:35:56.893594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:35:56.893803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:35:56.894137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:35:56.894968 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start _get_guest_xml network_info=[{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c5b10a07-4a3d-428c-b092-4d5061a56354', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9078c4c9-d972-44b1-843b-2320db6ee10a', 'attached_at': '', 'detached_at': '', 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'serial': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:35:56.898848 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:35:56.900280 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2058248421', uuid='9078c4c9-d972-44b1-843b-2320db6ee10a'), owner=OwnerMeta(userid='bdf7a94492f3476fb201e51478145d07', username='tempest-TestShelveInstance-710703435-project-member', projectid='582a6b9df4fc4204ba57f289f810d031', projectname='tempest-TestShelveInstance-710703435'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733356.8998768) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:35:56.901909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:35:56.902371 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:35:56.904481 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:35:56.904791 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:35:56.907398 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:35:56.907980 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:35:56.908174 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:35:56.908279 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:35:56.908452 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:35:56.908549 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:35:56.908712 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:35:56.908882 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:35:56.908978 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:35:56.909095 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:35:56.909314 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:35:56.909487 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:35:56.921766 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:35:56.922206 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:35:56.922394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:56.922802 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:56.923037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:35:56.946295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:56.947559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:35:56.948322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:56.948706 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:56.949181 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:35:56.949421 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:56.962644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:56.962644 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:56.976489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:35:56.976489 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475] added
May 14 04:35:56.981918 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:56.981918 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:56.981918 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475] added
May 14 04:35:56.988972 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:35:56.988972 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:56.988972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:35:56.989901 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:35:56.989980 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:35:57.016914 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:57.382378 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:35:57.512462 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:35:57.545093 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updated VIF entry in instance network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:35:57.545417 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:35:57.981976 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:35:57.990406 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:58.007552 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:58.007552 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:35:58.016407 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:35:58.016407 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.022987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.032909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.041736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.042049 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:58.047689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-03d7279d-e9b3-48d0-afae-024d12adea80 req-7d53942b-1fda-48fd-872d-5c55a7b997fd service nova] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.050849 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.051140 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:58.099099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260]
May 14 04:35:58.099099 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260] successful.
May 14 04:35:58.099099 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.114092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260]
May 14 04:35:58.114092 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260] successful.
May 14 04:35:58.114092 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.122797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.128649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.142016 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.142389 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:58.142389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:58.142659 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:58.143408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] HCTL ('14', '-', '-', 0) found on session 123 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:58.143437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.156175 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d76a2c05-a500-41e2-a174-e319773bc2bc (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:35:58.156588 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:35:58.157079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:58.157079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:35:58.158059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] HCTL ('15', '-', '-', 0) found on session 124 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:35:58.158241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:35:58.164968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching for a device in session 123 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:58.165108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:58.175865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching for a device in session 124 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:35:58.175865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:35:58.948777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:35:59.974345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Found WWN 3300000002a9f2042 for multipath device dm-5 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:35:59.974345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:35:59.974345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000002a9f2042', 'path': '/dev/dm-5', 'multipath_id': '3300000002a9f2042'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:35:59.974345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002a9f2042', 'path': '/dev/dm-5', 'multipath_id': '3300000002a9f2042'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:36:00.482643 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymCQWd3Z+7vZw4v/tetdIhFfgL9teebsgfE4tojPxbHFzyJ0esR0KSkptKmGwHM0Rg1VyaCD6nLE+KXDdifjEf7QN5fRih0Y1KsH1JmoRetDNk9mrUEKVYIELVs/sbCg==',key_name='tempest-TestShelveInstance-1575134270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:54Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:36:00.482643 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:00.482643 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:00.482643 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'pci_devices' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:00.989099 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <uuid>9078c4c9-d972-44b1-843b-2320db6ee10a</uuid>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <name>instance-00000037</name>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestShelveInstance-server-2058248421</nova:name>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:35:56</nova:creationTime>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:user uuid="bdf7a94492f3476fb201e51478145d07">tempest-TestShelveInstance-710703435-project-member</nova:user>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:project uuid="582a6b9df4fc4204ba57f289f810d031">tempest-TestShelveInstance-710703435</nova:project>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         <nova:port uuid="85da9544-f46c-4f84-add3-d8638cee4eee">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <system>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="serial">9078c4c9-d972-44b1-843b-2320db6ee10a</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="uuid">9078c4c9-d972-44b1-843b-2320db6ee10a</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </system>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <os>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </os>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <features>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </features>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   <devices>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <alias name="ua-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-5"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <serial>3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475</serial>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:85:84:8a"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <target dev="tap85da9544-f4"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </interface>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/console.log" append="off"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </serial>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <video>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </video>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </rng>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:   </devices>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]: </domain>
May 14 04:36:00.989099 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:36:00.989099 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Preparing to wait for external event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:36:00.989099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:00.989099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymCQWd3Z+7vZw4v/tetdIhFfgL9teebsgfE4tojPxbHFzyJ0esR0KSkptKmGwHM0Rg1VyaCD6nLE+KXDdifjEf7QN5fRih0Y1KsH1JmoRetDNk9mrUEKVYIELVs/sbCg==',key_name='tempest-TestShelveInstance-1575134270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:35:54Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:00.992370 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '271efac0-78d2-52a2-aacd-98879114fc01', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:00.994723 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:00.996905 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:00.997038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85da9544-f4, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:00.997336 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85da9544-f4, col_values=(('qos', UUID('ec6563b8-a981-47bf-94b0-e79e4825699e')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:00.997490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85da9544-f4, col_values=(('external_ids', {'iface-id': '85da9544-f46c-4f84-add3-d8638cee4eee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:84:8a', 'vm-uuid': '9078c4c9-d972-44b1-843b-2320db6ee10a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:00.998602 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:00.999955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:01.004727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:01.005917 np0000000747 nova-compute[97971]: INFO os_vif [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4')
May 14 04:36:01.132597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:01.132876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:01.133051 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:01.141509 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97971) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 04:36:01.142084 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'flavor' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:01.205888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:02.181416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:02.184500 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:02.212013 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:02.251401 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:02.418774 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:02.419963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:02.419963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:02.419963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:02.419963 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:02.419963 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5355179b-4d9c-4972-beb3-cb7dac6744ca req-34bbf382-c736-4366-a9d2-553c1038499f service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received unexpected event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with vm_state active and task_state powering-off.
May 14 04:36:02.510282 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999718394999945 future=<Future at 0x7436184271a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:02.510587 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998378733999743 future=<Future at 0x7436184271a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:02.510840 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998234716999832 future=<Future at 0x7436184271a0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:02.513119 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance destroyed successfully.
May 14 04:36:02.514105 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'numa_topology' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:02.533988 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:02.534962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:02.534962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No VIF found with MAC fa:16:3e:85:84:8a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:36:02.536366 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Using config drive
May 14 04:36:03.016315 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:03.016565 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:03.047492 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:03.199578 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating config drive at /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config
May 14 04:36:03.205657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1e2uv5a4 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:03.265538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1e2uv5a4" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:03.531705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d589f9e6-4137-44e1-9e37-84327aa2103d tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.398s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:03.810092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:03.818543 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:03.818543 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:03.819133 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Shelving
May 14 04:36:03.848094 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:03.936821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.181485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.188945 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.191055 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.217049 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.480958 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:04.482072 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:04.482333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:04.482333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:04.482460 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:04.482580 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received unexpected event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with vm_state stopped and task_state None.
May 14 04:36:04.482729 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:04.482864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:04.482991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:04.483097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:04.483220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Processing event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:36:04.483394 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:04.483536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:04.483704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:04.483815 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:04.483944 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:04.484557 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-5bf460fa-44d2-48c2-887b-8869fb2deb47 req-fd75bad5-ca93-4bd9-8469-052d12092f83 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received unexpected event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with vm_state building and task_state spawning.
May 14 04:36:04.611693 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:36:04.611693 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733364.6080062, 9078c4c9-d972-44b1-843b-2320db6ee10a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:04.611693 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Started (Lifecycle Event)
May 14 04:36:04.611693 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:36:04.614429 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance spawned successfully.
May 14 04:36:04.614762 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:36:04.862635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.869591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.897429 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.912304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.951362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:04.952458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:05.044799 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:05.046976 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:05.047176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:05.047311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:05.047474 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:05.047585 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2f5723af-eafb-43da-b0f3-60fa24be424a req-534fba7f-e69d-4816-89cd-e6a15606f704 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received unexpected event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with vm_state active and task_state shelving.
May 14 04:36:05.118240 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:05.122989 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:05.127999 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.128159 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.128505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.128850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.129104 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.129487 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:05.195858 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance destroyed successfully.
May 14 04:36:05.196346 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'numa_topology' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:05.236033 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'flavor' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:05.625855 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:36:05.626139 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733365.6259127, 9078c4c9-d972-44b1-843b-2320db6ee10a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:05.626221 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Paused (Lifecycle Event)
May 14 04:36:05.638461 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Took 8.75 seconds to spawn the instance on the hypervisor.
May 14 04:36:05.639530 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:05.742207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:05.742346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:05.742503 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:05.742665 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'info_cache' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:05.821974 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Beginning cold snapshot process
May 14 04:36:06.001017 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:06.128280 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:06.130979 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733366.1307507, 9078c4c9-d972-44b1-843b-2320db6ee10a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:06.131087 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Resumed (Lifecycle Event)
May 14 04:36:06.149381 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Took 16.01 seconds to build instance.
May 14 04:36:06.205374 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:06.245370 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,info_cache {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:06.633283 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:06.635415 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:06.650957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.515s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:06.748684 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:07.107381 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:07.107600 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:07.107828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:07.107940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:07.108075 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:07.108214 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b04074c8-f8b4-43e0-885c-04b02bb101fd req-eae05e9e-ad05-46d3-9643-87628c562e07 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received unexpected event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with vm_state active and task_state shelving_image_pending_upload.
May 14 04:36:07.141217 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.996693922999839 future=<Future at 0x74362d9a4980 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:07.155028 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:07.307502 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:07.335939 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:36:07.336464 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk /opt/stack/data/nova/instances/snapshots/tmprnlntual/3958fe68f15840d483c4e9f970e37f7c {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:07.384229 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:07.384491 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing instance network info cache due to event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:07.384793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:07.385203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:07.385203 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:07.603967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk /opt/stack/data/nova/instances/snapshots/tmprnlntual/3958fe68f15840d483c4e9f970e37f7c" returned: 0 in 0.267s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:07.604330 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Snapshot extracted, beginning image upload
May 14 04:36:07.807529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-31cf78b9-bf06-44b3-90ab-809461001d4e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:07.887727 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:08.258051 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:08.426343 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updated VIF entry in instance network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:36:08.426831 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:08.823490 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance destroyed successfully.
May 14 04:36:08.823946 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'numa_topology' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:08.932171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-46a7c3f2-f8d8-49b4-aa9e-dc0936326bfa req-4b4c37ca-8256-446e-92a5-cc681ed6e571 service nova] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:09.325894 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:09.326247 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:09.828629 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:09.830962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:09.832781 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:09.832781 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:09.832781 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:09.837775 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.840233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f7c414d-4d, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:09.841823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.843126 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:09.849156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.851046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.851046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a22ce180-009b-4aa3-9ade-c0729aad0cca) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:09.851046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.851728 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:09.857327 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:09.861030 np0000000747 nova-compute[97971]: INFO os_vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d')
May 14 04:36:09.867005 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:36:09.867005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:09.867005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:10.231134 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Snapshot image upload complete
May 14 04:36:10.231483 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:10.746753 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Shelve offloading
May 14 04:36:11.206813 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:11.255461 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance destroyed successfully.
May 14 04:36:11.255817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:11.257414 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:11.257585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:11.257811 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:11.325789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.459s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:11.326257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:36:11.326485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:11.367800 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:11.368166 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:11.368166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454', '125')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:36:11.368516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '112')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:11.373576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '113')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:11.373576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bfaa3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:36:11.373576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:36:11.373576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 33000000095206e37 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:36:11.434796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:11.490452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:11.545785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:36:11.545785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:36:11.547235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:36:11.561131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:36:11.561525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:36:11.573996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.606220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260]
May 14 04:36:11.606220 np0000000747 nova-compute[97971]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260] successful.
May 14 04:36:11.606220 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.623665 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.635280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.670576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260]
May 14 04:36:11.670576 np0000000747 nova-compute[97971]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260] successful.
May 14 04:36:11.670576 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.691978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:11.692252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:11.692480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (1825ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:11.692663 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:36:11.697101 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start _get_guest_xml network_info=[{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2df7727c-d3be-4251-af82-a0257bff6fac', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '31cf78b9-bf06-44b3-90ab-809461001d4e', 'attached_at': '', 'detached_at': '', 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'serial': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:36:11.699078 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:36:11.700187 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1211304667', uuid='31cf78b9-bf06-44b3-90ab-809461001d4e'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733371.6998668) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:36:11.701722 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:36:11.702089 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:36:11.703285 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:36:11.703508 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:36:11.704419 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:36:11.704788 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:36:11.704978 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:36:11.705119 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:36:11.705485 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:36:11.705485 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:36:11.705485 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:36:11.705715 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:36:11.705861 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:36:11.706044 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:36:11.706196 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:36:11.706359 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:36:11.706529 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:11.759885 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:12.179459 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:12.208690 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:12.224160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:12.337373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:12.338322 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:12.338634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:12.339584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:12.340077 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:36:12.340724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:12.340997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:12.341465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:12.342479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:36:12.355526 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:12.365157 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:12.365948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:12.366528 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:12.366792 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:36:12.367332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:12.367586 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:36:12.382324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:36:12.382324 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:12.389563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:36:12.389563 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:12.415083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5] added
May 14 04:36:12.415083 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:36:12.415083 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:12.415083 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:12.415083 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:12.415083 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:12.415083 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:12.415402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:36:12.415509 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0487(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:36:12.415868 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:36:12.417548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5] added
May 14 04:36:12.417548 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:36:12.417548 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:12.417548 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:12.417548 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:12.417548 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:12.417548 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:12.417774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:36:12.417916 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0503(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:36:12.418069 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:36:12.859271 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:12.859901 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:12.860128 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:13.414536 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance destroyed successfully.
May 14 04:36:13.415086 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'resources' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:13.416247 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:36:13.419715 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:36:13.432568 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:36:13.432568 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:36:13.454564 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:36:13.454564 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.464212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.470967 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.482144 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.482703 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.496030 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.496264 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:13.509779 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-changed-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:13.511929 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing instance network info cache due to event network-changed-5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:13.512041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:13.512212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:13.512344 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing network info cache for port 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:13.530883 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260]
May 14 04:36:13.530883 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260] successful.
May 14 04:36:13.530883 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.542600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260]
May 14 04:36:13.542600 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260] successful.
May 14 04:36:13.542600 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.543658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.562566 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.562985 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:13.563336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:13.563336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:36:13.564124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('9', '-', '-', 0) found on session 126 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:36:13.564267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:36:13.570122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:13.581039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 126 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:36:13.581217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.588724 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c27d6ae6-8a47-4749-9268-76e178d43454 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:13.589028 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:13.589193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:13.589322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:36:13.590490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('10', '-', '-', 0) found on session 127 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:36:13.590646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:36:13.604923 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 127 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:36:13.604923 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:36:13.917660 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:13.918734 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFRFfjoV+j/OvoLwium9/rPSNaVA3/SiVgF6zoWfaNnT/MGeygiKGOxBHVj4AZvSTys3p1oKEmkSJdG1rqUDi3DX/4R6jkRlpCBkalPadCRULAfEjSlJ33NYyrixeH1NA==',key_name='tempest-keypair-653108543',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:23Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:36:10.231188',shelved_host='np0000000747',shelved_image_id='6408f131-5a3f-4215-a039-8240c3249b17'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:13.918994 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:13.919823 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:13.920070 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:13.922977 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:13.922977 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5138acaa-86, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:13.925332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:13.925332 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:13.925994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:13.926248 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45e0710c-01ea-4be1-9279-e2ec25485cec) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:13.926889 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:13.927485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:13.929877 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:13.933139 np0000000747 nova-compute[97971]: INFO os_vif [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86')
May 14 04:36:13.933632 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Deleting instance files /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2_del
May 14 04:36:13.940921 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Deletion of /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2_del complete
May 14 04:36:14.017540 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:14.371113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:36:14.420647 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:14.554180 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Deleted allocations for instance 3186131b-429e-4d79-9dc3-be4059f42fc2
May 14 04:36:14.597633 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updated VIF entry in instance network info cache for port 5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:36:14.598443 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5138acaa-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:15.059117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:15.059364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:15.101683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe34bd13-7df3-4654-b3fd-a93f4cf4045c req-05e9dd68-23d5-4e9a-9757-adf59e52d6d8 service nova] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:15.392628 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:15.394368 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:15.396964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 33000000095206e37 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:36:15.396964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:15.396964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '33000000095206e37', 'path': '/dev/dm-1', 'multipath_id': '33000000095206e37'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:15.396964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000095206e37', 'path': '/dev/dm-1', 'multipath_id': '33000000095206e37'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:36:15.898370 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:15.908114 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:36:15.908114 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:15.908114 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:15.909197 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:16.207860 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.414116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.354s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:16.418914 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Object Instance<31cf78b9-bf06-44b3-90ab-809461001d4e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:16.419405 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <uuid>31cf78b9-bf06-44b3-90ab-809461001d4e</uuid>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <name>instance-00000035</name>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1211304667</nova:name>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:36:11</nova:creationTime>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         <nova:port uuid="5f7c414d-4daa-4750-81d9-b91cc1c25a87">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <system>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="serial">31cf78b9-bf06-44b3-90ab-809461001d4e</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="uuid">31cf78b9-bf06-44b3-90ab-809461001d4e</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </system>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <os>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </os>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <features>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </features>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   <devices>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <alias name="ua-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <serial>1daf23d7-cb21-4dfc-aa37-50b99a36a0a5</serial>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:35:f7:f3"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <target dev="tap5f7c414d-4d"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </interface>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/console.log" append="off"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </serial>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <video>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </video>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </rng>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:   </devices>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]: </domain>
May 14 04:36:16.419405 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:36:16.424861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:36:16.424861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:36:16.424861 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:16.424861 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:16.424861 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:36:16.425333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.425333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:16.426188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:36:16.427691 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.427691 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '904c0cc6-0c10-5d81-8f28-560aa1f34c24', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:16.428211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.428895 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:16.430052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.433510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.433710 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f7c414d-4d, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:16.433997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f7c414d-4d, col_values=(('qos', UUID('677fb521-d76c-4765-bdf9-9871e9647edc')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:16.434159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f7c414d-4d, col_values=(('external_ids', {'iface-id': '5f7c414d-4daa-4750-81d9-b91cc1c25a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:f7:f3', 'vm-uuid': '31cf78b9-bf06-44b3-90ab-809461001d4e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:16.435069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.437190 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:16.443588 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.446318 np0000000747 nova-compute[97971]: INFO os_vif [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d')
May 14 04:36:16.886646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.914667 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:16.923397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9bf7613-2b9f-4bd3-971e-a4bb06f358b6 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.105s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:17.024338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:17.123703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:17.127750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:17.127750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:17.127872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:17.127959 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:17.128069 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-a7c2640b-2354-4efb-8072-f923428eebd1 req-dcfd9722-c8cb-45d3-aecb-b853c8091460 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received unexpected event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with vm_state stopped and task_state powering-on.
May 14 04:36:17.287747 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:17.287747 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:17.290160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:17.312817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:17.509667 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005078789999970468 future=<Future at 0x7436184271a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:17.509667 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:17.509878 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.628040358999897 future=<Future at 0x74362d9a4980 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:17.510020 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=4.627939351999885 future=<Future at 0x74362d9a4980 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:17.510421 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Emitting event <LifecycleEvent: 1778733362.508878, 31cf78b9-bf06-44b3-90ab-809461001d4e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:17.510627 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Stopped (Lifecycle Event)
May 14 04:36:17.751425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for 31cf78b9-bf06-44b3-90ab-809461001d4e due to new event <LifecycleEvent: 1778733377.751129, 31cf78b9-bf06-44b3-90ab-809461001d4e => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:36:17.751545 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733377.751129, 31cf78b9-bf06-44b3-90ab-809461001d4e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:17.751679 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Resumed (Lifecycle Event)
May 14 04:36:17.752557 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:36:17.755404 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance rebooted successfully.
May 14 04:36:17.962346 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:17.962810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:17.962810 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Unshelving
May 14 04:36:18.013201 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:18.254178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:18.256146 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:18.610660 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:18.610790 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:18.611053 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:18.759399 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:36:18.759688 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733378.7594798, 31cf78b9-bf06-44b3-90ab-809461001d4e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:18.759817 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Started (Lifecycle Event)
May 14 04:36:19.018946 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:19.019382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:19.022319 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_requests' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:19.186597 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:19.187055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:19.187241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:19.187328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:19.187498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:19.187652 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fdf81cbe-df1b-468a-a3ca-8ed5bc46d84c req-06b980cb-1705-4e84-ad0c-f7c9192de80b service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received unexpected event network-vif-plugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with vm_state stopped and task_state powering-on.
May 14 04:36:19.263454 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:19.265779 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:19.266021 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:19.266230 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:35:f7:f3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:36:19.266507 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:19.268044 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aadb0ffa-6587-42cd-86a7-eaaf21170521 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:19.527257 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'numa_topology' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:19.769605 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:36:20.029505 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:36:20.029929 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Claim successful on node np0000000747
May 14 04:36:20.266799 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ea43292c-f2ef-456c-9cf3-f96e7a1203bb tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Get console output
May 14 04:36:20.270305 np0000000747 nova-compute[97971]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 14 04:36:20.601777 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:20.602052 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:21.211949 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:21.337720 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:21.337964 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:21.436388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:21.840426 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:22.138377 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00035823799998979666 future=<Future at 0x74362d9a4980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:22.139797 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Emitting event <LifecycleEvent: 1778733367.137797, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:22.139797 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Stopped (Lifecycle Event)
May 14 04:36:22.140162 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:22.346487 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.327s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:22.346998 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:22.421445 np0000000747 nova-compute[97971]: INFO nova.network.neutron [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating port 5138acaa-8641-40f4-8060-53339de07d09 with attributes {'binding:host_id': 'np0000000747', 'device_owner': 'compute:nova'}
May 14 04:36:22.439181 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:22.439371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:22.439526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:22.439658 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:22.439768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:22.441833 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Terminating instance
May 14 04:36:22.609761 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:22.609973 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:22.644786 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-87dbf86f-038f-4375-8ffb-250c3f89c764 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:22.945800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:36:22.980825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:22.983471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.001206 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.008100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.038323 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.062242 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:23.062540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:23.062705 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:23.115536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:23.115842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:23.116033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:23.116543 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:36:23.124558 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-changed-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:23.124800 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing instance network info cache due to event network-changed-5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:23.125259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] Acquiring lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:23.157460 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:23.159273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:23.159273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:23.159273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:23.159273 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:23.159273 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7942a3e4-1543-472c-8eb2-ca91ff305a58 req-8914cd20-31b2-4e9e-aa34-acdcc5e700c0 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:36:23.298744 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999676408000141 future=<Future at 0x7435f85bd340 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:23.298744 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999251368000387 future=<Future at 0x7435f85bd340 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:23.299731 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997659999999996 future=<Future at 0x7435f85bd340 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:23.304006 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Instance destroyed successfully.
May 14 04:36:23.306742 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 31cf78b9-bf06-44b3-90ab-809461001d4e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:23.565057 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:23.809060 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1211304667',display_name='tempest-TestVolumeBootPattern-server-1211304667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1211304667',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdRW3E3YDkqkyHyqmgz4ysA3QWTlNOJMjVj0G+B10+OmLE8eSOVI3hsZ1DQu0h4tSC/h59oeFKH0qqLdB1IGLZZfXj7vNF2fXOvm7+vbJZ1CM1gjXrZWtfNz8kRitMw0w==',key_name='tempest-keypair-1303458885',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s6fhs2jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=31cf78b9-bf06-44b3-90ab-809461001d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:23.809308 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "address": "fa:16:3e:35:f7:f3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7c414d-4d", "ovs_interfaceid": "5f7c414d-4daa-4750-81d9-b91cc1c25a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:23.810110 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:23.810280 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:23.811358 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.812394 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f7c414d-4d, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:23.816785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.817728 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:23.818291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.818546 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677fb521-d76c-4765-bdf9-9871e9647edc) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:23.822202 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.822767 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:23.831235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:23.835250 np0000000747 nova-compute[97971]: INFO os_vif [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:f7:f3,bridge_name='br-int',has_traffic_filtering=True,id=5f7c414d-4daa-4750-81d9-b91cc1c25a87,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7c414d-4d')
May 14 04:36:23.838343 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:36:23.838684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:23.838845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:23.839241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:23.839583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:36:23.839801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9063664-47bb-463b-ba0e-8d9b2deb6bb7 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aeba9215-d79f-4b59-9920-e0c2f19963dc (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9063664-47bb-463b-ba0e-8d9b2deb6bb7 (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aeba9215-d79f-4b59-9920-e0c2f19963dc (non-flash)
May 14 04:36:23.879166 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:23.879166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9063664-47bb-463b-ba0e-8d9b2deb6bb7', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aeba9215-d79f-4b59-9920-e0c2f19963dc', '129')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:36:23.880178 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '126')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:23.880384 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5', '127')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:23.881482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f827a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:36:23.881736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:36:23.881953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 33000000095206e37 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:36:23.939330 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:23.988467 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:24.004608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:24.069382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:36:24.069667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:36:24.071323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:36:24.089013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:36:24.089484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:36:24.106246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.162827 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260]
May 14 04:36:24.162827 np0000000747 nova-compute[97971]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.40.100,3260] successful.
May 14 04:36:24.162827 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.175116 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:24.186705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.201779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.268041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260]
May 14 04:36:24.268041 np0000000747 nova-compute[97971]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-1daf23d7-cb21-4dfc-aa37-50b99a36a0a5, portal: 192.168.50.100,3260] successful.
May 14 04:36:24.268041 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.289745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:24.290040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:24.290215 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (451ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:24.290346 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:36:24.290680 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Deleting instance files /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e_del
May 14 04:36:24.291325 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Deletion of /opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e_del complete
May 14 04:36:24.336829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:24.445927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:24.447713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:24.583812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:24.586288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:36:24.603091 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:36:24.613374 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000035, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/31cf78b9-bf06-44b3-90ab-809461001d4e/disk.config'
May 14 04:36:24.622547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:24.681023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:24.683969 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:36:24.684578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] Acquired lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:24.684897 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Refreshing network info cache for port 5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:24.687892 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating image(s)
May 14 04:36:24.689576 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:24.689777 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:24.690449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:24.690773 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:24.763217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:24.763661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:24.804960 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Took 1.86 seconds to destroy the instance on the hypervisor.
May 14 04:36:24.806051 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:36:24.806392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:36:24.806560 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:36:24.807334 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:24.867646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:24.868057 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:36:24.871312 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:36:24.872458 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:24.921394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:24.921954 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12767MB free_disk=72.86100769042969GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:36:24.922211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:24.923355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:24.943163 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:25.190379 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:25.193008 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:25.193684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:25.194188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] Acquiring lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] No waiting events found dispatching network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:25.255438 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a644f5d3-b5cb-4c99-a95c-fa3878fcde15 req-8032f62d-a63d-450f-9996-ef83e9d27ffc service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-unplugged-5f7c414d-4daa-4750-81d9-b91cc1c25a87 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:36:25.498405 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6f6de7e9-e47d-41b6-82e9-c73435a53c5d req-14e68253-42ed-4612-a40d-e04368dc56b6 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Received event network-vif-deleted-5f7c414d-4daa-4750-81d9-b91cc1c25a87 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:25.498490 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-6f6de7e9-e47d-41b6-82e9-c73435a53c5d req-14e68253-42ed-4612-a40d-e04368dc56b6 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Neutron deleted interface 5f7c414d-4daa-4750-81d9-b91cc1c25a87; detaching it from the instance and deleting it from the info cache
May 14 04:36:25.498682 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6f6de7e9-e47d-41b6-82e9-c73435a53c5d req-14e68253-42ed-4612-a40d-e04368dc56b6 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:25.636513 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:25.820937 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updated VIF entry in instance network info cache for port 5138acaa-8641-40f4-8060-53339de07d09. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:36:25.821293 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:25.932097 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:25.990386 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:36:25.990557 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:36:25.991420 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 31cf78b9-bf06-44b3-90ab-809461001d4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:36:25.991420 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9078c4c9-d972-44b1-843b-2320db6ee10a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:36:25.991420 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 3186131b-429e-4d79-9dc3-be4059f42fc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:36:25.991420 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:36:25.991609 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:36:24 up 36 min,  2 users,  load average: 6.93, 8.12, 5.32\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_7c56a1dd0473425da8eddafc3d4c27a7': '1', 'io_workload': '0', 'num_proj_ffc8341628a343b88c90dd7e5d8e5427': '1', 'num_task_deleting': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_4b66752be38742a38c2a4ef876561d9a': '1', 'num_proj_582a6b9df4fc4204ba57f289f810d031': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:36:26.004506 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6f6de7e9-e47d-41b6-82e9-c73435a53c5d req-14e68253-42ed-4612-a40d-e04368dc56b6 service nova] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Detach interface failed, port_id=5f7c414d-4daa-4750-81d9-b91cc1c25a87, reason: Instance 31cf78b9-bf06-44b3-90ab-809461001d4e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:36:26.161705 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.164858 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.165400 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.part --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.213382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:26.271047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.part --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.271935 np0000000747 nova-compute[97971]: DEBUG nova.virt.images [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] 6408f131-5a3f-4215-a039-8240c3249b17 was qcow2, converting to raw {{(pid=97971) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 14 04:36:26.272810 np0000000747 nova-compute[97971]: DEBUG nova.privsep.utils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=97971) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 14 04:36:26.274163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.part /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.converted {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.325228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06f639db-2f60-45c6-b536-95f6bbbe9462 req-846ca7bb-fc22-4d74-a0ec-75b2f2ee0606 service nova] Releasing lock "refresh_cache-3186131b-429e-4d79-9dc3-be4059f42fc2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:26.406223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:26.406461 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:26.435263 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Took 1.63 seconds to deallocate network for instance.
May 14 04:36:26.461929 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.part /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.converted" returned: 0 in 0.189s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.477537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.converted --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.584433 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44.converted --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.585243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.391s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:26.585911 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.589310 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.590746 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.697675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.698265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:26.698864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:26.699507 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.703349 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:26.703750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.817194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json" returned: 0 in 0.113s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.817874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44,backing_fmt=raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.883008 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44,backing_fmt=raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk 1073741824" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.885039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "bdff741b73cde6773e0e439d4cace6aebb0ffe44" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:26.885418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:26.915438 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:26.979752 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdff741b73cde6773e0e439d4cace6aebb0ffe44 --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:26.980226 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'migration_context' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:27.002465 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Took 0.57 seconds to detach 1 volumes for instance.
May 14 04:36:27.428417 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:36:27.428709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.506s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:27.429171 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:27.484017 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:27.484420 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Rebasing disk image.
May 14 04:36:27.484715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:27.520026 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:27.520510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:27.605545 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.121s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:27.606146 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 -F raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:27.901734 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:27.902212 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:28.408884 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:28.422429 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:28.422429 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:28.422429 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:28.422429 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:36:28.422429 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.19 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:28.497973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 -F raw /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk" returned: 0 in 0.892s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:28.498337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:36:28.498592 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Ensure instance console log exists: /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:36:28.498775 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:28.498956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:28.499067 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:28.500528 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start _get_guest_xml network_info=[{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='95bdd679749fc469076dcf8b6a5bdaa2',container_format='bare',created_at=2026-05-14T04:36:03Z,direct_url=<?>,disk_format='qcow2',id=6408f131-5a3f-4215-a039-8240c3249b17,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1774273441-shelved',owner='4b66752be38742a38c2a4ef876561d9a',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T04:36:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:36:28.502834 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:36:28.504373 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1774273441', uuid='3186131b-429e-4d79-9dc3-be4059f42fc2'), owner=OwnerMeta(userid='bd917914b2414921963ae67e7a9780f1', username='tempest-AttachVolumeShelveTestJSON-1339972729-project-member', projectid='4b66752be38742a38c2a4ef876561d9a', projectname='tempest-AttachVolumeShelveTestJSON-1339972729'), image=ImageMeta(id='6408f131-5a3f-4215-a039-8240c3249b17', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733388.5039616) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:36:28.505537 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:36:28.505998 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:36:28.507328 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:36:28.507526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:36:28.508487 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:36:28.508865 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='95bdd679749fc469076dcf8b6a5bdaa2',container_format='bare',created_at=2026-05-14T04:36:03Z,direct_url=<?>,disk_format='qcow2',id=6408f131-5a3f-4215-a039-8240c3249b17,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1774273441-shelved',owner='4b66752be38742a38c2a4ef876561d9a',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-14T04:36:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:36:28.509014 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:36:28.509180 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:36:28.509230 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:36:28.509364 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:36:28.509490 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:36:28.509705 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:36:28.509826 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:36:28.509982 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:36:28.510110 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:36:28.510279 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:36:28.510468 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:28.610429 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:36:28.610762 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:28.825902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:28.925040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.404s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:28.990721 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 31cf78b9-bf06-44b3-90ab-809461001d4e
May 14 04:36:29.013221 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:29.026444 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='6408f131-5a3f-4215-a039-8240c3249b17',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-653108543',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:23Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:36:10.231188',shelved_host='np0000000747',shelved_image_id='6408f131-5a3f-4215-a039-8240c3249b17'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:36:29.026712 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:29.027556 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:29.028180 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'pci_devices' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:29.530033 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:29.530934 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] End _get_guest_xml xml=<domain type="qemu">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <uuid>3186131b-429e-4d79-9dc3-be4059f42fc2</uuid>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <name>instance-00000036</name>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1774273441</nova:name>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:36:28</nova:creationTime>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:user uuid="bd917914b2414921963ae67e7a9780f1">tempest-AttachVolumeShelveTestJSON-1339972729-project-member</nova:user>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:project uuid="4b66752be38742a38c2a4ef876561d9a">tempest-AttachVolumeShelveTestJSON-1339972729</nova:project>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         <nova:port uuid="5138acaa-8641-40f4-8060-53339de07d09">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <system>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="serial">3186131b-429e-4d79-9dc3-be4059f42fc2</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="uuid">3186131b-429e-4d79-9dc3-be4059f42fc2</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </system>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <os>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </os>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <features>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </features>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   <devices>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:6f:37:11"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <target dev="tap5138acaa-86"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </interface>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/console.log" append="off"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </serial>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <video>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </video>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </rng>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:   </devices>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]: </domain>
May 14 04:36:29.530934 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Preparing to wait for external event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='6408f131-5a3f-4215-a039-8240c3249b17',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-653108543',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:35:23Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member',shelved_at='2026-05-14T04:36:10.231188',shelved_host='np0000000747',shelved_image_id='6408f131-5a3f-4215-a039-8240c3249b17'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:36:29.532637 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:29.532889 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:29.532889 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:36:29.533304 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.533757 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:29.534042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:36:29.534748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.534915 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f688c75-2568-58ae-b7fd-75bb5dc7c293', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:29.535668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.536294 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:29.536997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.539631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.539852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5138acaa-86, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:29.540181 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5138acaa-86, col_values=(('qos', UUID('b88d9192-b070-41de-9358-d2864b4d2b4f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:29.540408 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5138acaa-86, col_values=(('external_ids', {'iface-id': '5138acaa-8641-40f4-8060-53339de07d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:37:11', 'vm-uuid': '3186131b-429e-4d79-9dc3-be4059f42fc2'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:29.541156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.543121 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:29.546859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:29.547985 np0000000747 nova-compute[97971]: INFO os_vif [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86')
May 14 04:36:29.999532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-426ca8ee-ec85-4410-86f8-38511d2b0016 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "31cf78b9-bf06-44b3-90ab-809461001d4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.560s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:31.065531 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:31.065974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:31.065974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] No VIF found with MAC fa:16:3e:6f:37:11, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:36:31.066285 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Using config drive
May 14 04:36:31.211733 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:31.568965 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'ec2_ids' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:32.072245 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:32.072632 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'keypairs' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:32.575290 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Object Instance<3186131b-429e-4d79-9dc3-be4059f42fc2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:32.579084 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:32.741792 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Creating config drive at /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config
May 14 04:36:32.746940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp85b_6dki {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:32.809386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp85b_6dki" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:33.304506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.337442 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.388644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:33.388644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:33.429018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.521243 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6fe12dc3-2a41-4695-ad9f-ff655b354d14 req-c366899c-4810-494f-b54a-b382abe93e43 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:33.521243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6fe12dc3-2a41-4695-ad9f-ff655b354d14 req-c366899c-4810-494f-b54a-b382abe93e43 service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:33.521243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6fe12dc3-2a41-4695-ad9f-ff655b354d14 req-c366899c-4810-494f-b54a-b382abe93e43 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:33.523023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6fe12dc3-2a41-4695-ad9f-ff655b354d14 req-c366899c-4810-494f-b54a-b382abe93e43 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:33.523810 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6fe12dc3-2a41-4695-ad9f-ff655b354d14 req-c366899c-4810-494f-b54a-b382abe93e43 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Processing event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:36:33.680948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.689028 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.709090 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:33.891455 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Detaching volume 588ad83b-dc6b-492e-8d75-0479630960ba
May 14 04:36:33.934347 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Attempting to driver detach volume 588ad83b-dc6b-492e-8d75-0479630960ba from mountpoint /dev/vdb
May 14 04:36:33.941278 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdb by alias ua-588ad83b-dc6b-492e-8d75-0479630960ba {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:36:33.942418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdb by alias ua-588ad83b-dc6b-492e-8d75-0479630960ba {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:36:33.942522 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Attempting to detach device vdb from instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:36:33.942790 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <alias name="ua-588ad83b-dc6b-492e-8d75-0479630960ba"/>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <serial>588ad83b-dc6b-492e-8d75-0479630960ba</serial>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]: </disk>
May 14 04:36:33.942790 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:36:33.950408 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdb from instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 from the persistent domain config.
May 14 04:36:33.950603 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] (1/8): Attempting to detach device vdb with device alias ua-588ad83b-dc6b-492e-8d75-0479630960ba from instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:36:33.950863 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <alias name="ua-588ad83b-dc6b-492e-8d75-0479630960ba"/>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <serial>588ad83b-dc6b-492e-8d75-0479630960ba</serial>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]: </disk>
May 14 04:36:33.950863 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:36:34.119706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:34.119866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:34.204688 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:36:34.205299 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733394.204983, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:34.205454 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Started (Lifecycle Event)
May 14 04:36:34.209106 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:36:34.214376 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance spawned successfully.
May 14 04:36:34.542629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:34.565127 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:34.611010 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-588ad83b-dc6b-492e-8d75-0479630960ba for instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:36:34.623193 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Detaching volume 920720a7-ab77-4d52-b515-94272c01e525
May 14 04:36:34.664540 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Attempting to driver detach volume 920720a7-ab77-4d52-b515-94272c01e525 from mountpoint /dev/vdb
May 14 04:36:34.668723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found disk vdb by alias ua-920720a7-ab77-4d52-b515-94272c01e525 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:36:34.669842 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Found disk vdb by alias ua-920720a7-ab77-4d52-b515-94272c01e525 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:36:34.670017 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Attempting to detach device vdb from instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:36:34.670165 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <alias name="ua-920720a7-ab77-4d52-b515-94272c01e525"/>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <serial>920720a7-ab77-4d52-b515-94272c01e525</serial>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]: </disk>
May 14 04:36:34.670165 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:36:34.676760 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully detached device vdb from instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe from the persistent domain config.
May 14 04:36:34.676951 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] (1/8): Attempting to detach device vdb with device alias ua-920720a7-ab77-4d52-b515-94272c01e525 from instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:36:34.677262 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <alias name="ua-920720a7-ab77-4d52-b515-94272c01e525"/>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <serial>920720a7-ab77-4d52-b515-94272c01e525</serial>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]: </disk>
May 14 04:36:34.677262 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:36:34.710312 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:34.712687 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:35.081556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-38b532ef-5a2e-4acb-9cb5-c3df00c46e5e tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.119s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:35.190888 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-920720a7-ab77-4d52-b515-94272c01e525 for instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:36:35.215173 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733395.2148232, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:35.215382 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Paused (Lifecycle Event)
May 14 04:36:35.589277 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:36:35.601204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:35.601204 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:35.601204 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:35.601568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:35.601568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:35.601674 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-072e6342-f2b5-45e2-ab8a-58d39ae2afc2 req-8f62acd6-2aa5-4907-8e76-ab8a54aafabd service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received unexpected event network-vif-plugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with vm_state active and task_state None.
May 14 04:36:35.719154 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:35.721279 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733395.7210364, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:35.721452 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Resumed (Lifecycle Event)
May 14 04:36:35.779745 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:35.779908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:36.216633 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:36.224989 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:36.227367 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:36.281550 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:36:36.730113 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733396.7298353, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => ua-588ad83b-dc6b-492e-8d75-0479630960ba> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:36:36.732067 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733396.7318223, 61825815-2fef-44e5-bdb6-4f40ea7e49fe => ua-920720a7-ab77-4d52-b515-94272c01e525> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:36:36.732771 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdb from instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 from the live domain config.
May 14 04:36:36.734416 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:36:36.734739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:36.735232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:36.735941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:36.736282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '588ad83b-dc6b-492e-8d75-0479630960ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:36:36.736423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:36:36.737051 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully detached device vdb from instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe from the live domain config.
May 14 04:36:36.738113 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:36:36.738481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:36.738627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:36.766751 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:36.766929 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:36.767058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:36:36.767132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '120')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:36.768000 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba', '121')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:36.768688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618489bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:36:36.768886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:36:36.769107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flush multipath device 330000000bbfbb071 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:36:36.808057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:36.845823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:36.845823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:36.848275 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:36:36.848587 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Claim successful on node np0000000747
May 14 04:36:36.864300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:36.928755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:36:36.928976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:36:36.930341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:36:36.943808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:36:36.944064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:36:36.958450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:36.991988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260]
May 14 04:36:36.991988 np0000000747 nova-compute[97971]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.40.100,3260] successful.
May 14 04:36:36.991988 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.007133 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.018822 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.050204 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260]
May 14 04:36:37.050204 np0000000747 nova-compute[97971]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-588ad83b-dc6b-492e-8d75-0479630960ba, portal: 192.168.50.100,3260] successful.
May 14 04:36:37.050204 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.063067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.063354 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:37.063485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== disconnect_volume: return (328ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:37.063596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:36:37.064019 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.325s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:37.064907 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '920720a7-ab77-4d52-b515-94272c01e525', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:36:37.069973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:36:37.096146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:37.096146 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:37.096146 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:37.096146 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:37.096146 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:37.096315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsi session list stdout=tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:37.096315 np0000000747 nova-compute[97971]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525 (non-flash)
May 14 04:36:37.096315 np0000000747 nova-compute[97971]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:37.096315 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:37.096315 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:37.096396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:36:37.096479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '118')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:37.097230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525', '119')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:37.097867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b5ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:36:37.098032 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:36:37.098243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Flush multipath device 330000000704119b0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:36:37.134036 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:37.183468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:37.230118 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:36:37.230328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:36:37.231177 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:36:37.245499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:36:37.245790 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:36:37.258450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.289427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.40.100,3260]
May 14 04:36:37.289427 np0000000747 nova-compute[97971]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.40.100,3260] successful.
May 14 04:36:37.289427 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.301992 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.312055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.342496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.50.100,3260]
May 14 04:36:37.342496 np0000000747 nova-compute[97971]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-920720a7-ab77-4d52-b515-94272c01e525, portal: 192.168.50.100,3260] successful.
May 14 04:36:37.342496 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.356063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:37.356063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:37.356063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] <== disconnect_volume: return (616ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:37.356063 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:36:37.625835 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:37.959855 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'flavor' on Instance uuid 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:38.184768 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:38.185046 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:38.297706 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00036612299982152763 future=<Future at 0x7435f85bd340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:38.298321 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733383.2972379, 31cf78b9-bf06-44b3-90ab-809461001d4e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:38.298939 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:38.299175 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] VM Stopped (Lifecycle Event)
May 14 04:36:38.635553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5e3f29f7-a433-4c84-b8dd-be25cb1408cb tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.247s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:38.687694 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:38.693522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:38.693874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:38.694042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:38.695890 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=97971) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 14 04:36:38.697637 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:38.801877 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 31cf78b9-bf06-44b3-90ab-809461001d4e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:38.967048 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c6dac86a-9362-445d-a9b3-9c2585db81b3 tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.847s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:39.195758 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.350s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:39.195758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:36:39.437144 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:39.437386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:39.437594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:39.437782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:39.438014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:39.440799 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Terminating instance
May 14 04:36:39.547964 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.706705 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:36:39.706961 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:36:39.707311 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:39.707529 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:39.730333 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.738144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.757725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.762444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.781282 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.787797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:39.792710 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:36:39.943673 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:36:39.988919 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:39.990189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:39.990881 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:39.991196 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:39.991322 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:39.991445 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-7bb0091f-7746-4e97-b333-196b5f87480f req-8534cdfc-b82e-4cb0-af1c-c07be0bd331a service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state active and task_state powering-off.
May 14 04:36:39.991741 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.009971 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.034484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.043062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.050191 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99968324099973 future=<Future at 0x7436184f4da0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:40.051080 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999297043999832 future=<Future at 0x7436184f4da0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:40.051080 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999170277999838 future=<Future at 0x7436184f4da0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:40.052050 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance destroyed successfully.
May 14 04:36:40.053257 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'numa_topology' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:40.211506 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:36:40.269189 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:40.269582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:40.269750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:40.269851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:40.270282 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] No waiting events found dispatching network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:40.270282 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8681cb69-ef0d-47c1-ab8b-9e8806fe8e90 req-b0f57374-336e-4297-bc86-c5ecf1970d8f service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:36:40.276147 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999761897000099 future=<Future at 0x743618384a40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:40.278470 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Instance destroyed successfully.
May 14 04:36:40.278544 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lazy-loading 'resources' on Instance uuid 61825815-2fef-44e5-bdb6-4f40ea7e49fe {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:40.414911 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Successfully created port: 880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:36:40.554418 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:40.554590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:40.714958 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:36:40.780933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-905468649',display_name='tempest-VolumesBackupsTest-instance-905468649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumesbackupstest-instance-905468649',id=52,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfamFBr/1E07NVTKQCg9j1N6uTn37j1OxSoxdOajA5MY3b6bmpnbxikUVxyzTD51FYgHWmwK0sX9XSP/aQxKQ4m/xKAF4tjht56p8CNmnudxZAf0myRPU3uhrLdyUtPFQ==',key_name='tempest-keypair-1567023603',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:59Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffc8341628a343b88c90dd7e5d8e5427',ramdisk_id='',reservation_id='r-c1lvh4sy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1649149288',owner_user_name='tempest-VolumesBackupsTest-1649149288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dbaabfe41f14fa1bcff4d715af5f989',uuid=61825815-2fef-44e5-bdb6-4f40ea7e49fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:40.781175 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converting VIF {"id": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "address": "fa:16:3e:e8:33:8a", "network": {"id": "629a816e-ddfe-463a-82dc-a0187ceecaa2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-254895590-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ffc8341628a343b88c90dd7e5d8e5427", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd819937e-c4", "ovs_interfaceid": "d819937e-c482-4d8c-85d3-10cd3f016c1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:40.781874 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:40.782116 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:40.784359 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.784359 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd819937e-c4, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:40.785810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.785810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:40.792380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.800882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.800882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ac7a464-0743-4a90-a63c-372dc0dcc0d6) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:40.800882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.800882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:40.804111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:40.805722 np0000000747 nova-compute[97971]: INFO os_vif [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=d819937e-c482-4d8c-85d3-10cd3f016c1b,network=Network(629a816e-ddfe-463a-82dc-a0187ceecaa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd819937e-c4')
May 14 04:36:40.805968 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Deleting instance files /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe_del
May 14 04:36:40.806757 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Deletion of /opt/stack/data/nova/instances/61825815-2fef-44e5-bdb6-4f40ea7e49fe_del complete
May 14 04:36:40.880376 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Successfully updated port: 880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:36:40.940278 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-changed-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:40.940416 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Refreshing instance network info cache due to event network-changed-880062a7-7b42-497c-9b21-49595bf5b79b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:40.943582 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] Acquiring lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:40.944177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] Acquired lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:40.944357 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Refreshing network info cache for port 880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:41.062560 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b9a7daf2-f99b-4865-b1f8-ecbfa7d67062 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.369s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:41.217601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:41.219633 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Booting with volume snapshot 1cae5b1a-9cfb-4678-84ec-8c08d3635ce1 at /dev/vda
May 14 04:36:41.312407 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Took 1.37 seconds to destroy the instance on the hypervisor.
May 14 04:36:41.313001 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:36:41.313162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:36:41.313292 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:36:41.313513 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:41.373026 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:41.382948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:41.446366 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:41.501937 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:41.542605 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:36:41.698449 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:41.940994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:42.008342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:42.008460 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquired lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:42.008602 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:42.008765 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'info_cache' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:42.070755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:42.071098 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:42.071151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:42.071333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:42.071504 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:42.072216 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state stopped and task_state powering-on.
May 14 04:36:42.072405 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-deleted-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:42.072628 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Neutron deleted interface d819937e-c482-4d8c-85d3-10cd3f016c1b; detaching it from the instance and deleting it from the info cache
May 14 04:36:42.072902 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:42.200388 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4ce43898-d58f-4ae6-8c43-6eb5a247be2c req-5b0b31ae-a3e4-4eef-ae1d-5ea2ee43f7f7 service nova] Releasing lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:42.201916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:42.201916 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:42.274913 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:42.341939 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:42.342160 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] Acquiring lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:42.342367 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:42.342514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:42.342669 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] No waiting events found dispatching network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:42.343259 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bfdf9c64-6b64-4b56-be2e-7486d4f95ac5 req-faa816b2-a632-43f6-b7bd-8c021600a364 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Received event network-vif-unplugged-d819937e-c482-4d8c-85d3-10cd3f016c1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:36:42.511326 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:42.576605 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9653b14f-17d8-402c-a380-97e4d1bcc559 req-a1385336-938e-47f1-ad0e-1105b829dc08 service nova] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Detach interface failed, port_id=d819937e-c482-4d8c-85d3-10cd3f016c1b, reason: Instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:36:42.776802 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Took 1.46 seconds to deallocate network for instance.
May 14 04:36:42.784737 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:36:42.957043 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:43.013885 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:43.103383 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Updating instance_info_cache with network_info: [{"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:43.289604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:43.289768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:43.364133 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:43.556247 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:43.606011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-4c341c8c-ba1f-4ed6-9b89-faa1384b225a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:43.607158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance network_info: |[{"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:36:43.641014 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:43.641336 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:44.058931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Releasing lock "refresh_cache-ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:44.144647 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:44.284010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:44.546328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:44.546530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:44.546699 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Shelve offloading
May 14 04:36:44.651899 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.362s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:44.675414 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:44.689100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:36:44.705394 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Deleted allocations for instance 61825815-2fef-44e5-bdb6-4f40ea7e49fe
May 14 04:36:44.711436 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:44.763794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:36:44.764250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:36:44.774427 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:36:44.777016 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe85:848a', 'fe80::889a:97ff:feb9:f2c', 'fe80::fc16:3eff:fe6f:3711', 'fe80::74de:beff:fe87:e3c8'] 
May 14 04:36:44.777314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:36:44.777415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:36:44.777770 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:44.778510 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Updating existing volume attachment record: 5a8c87a2-752f-425b-bc5b-0b0900de817a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:36:45.071670 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance destroyed successfully.
May 14 04:36:45.071979 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'numa_topology' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:45.574068 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:45.574068 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'resources' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:45.582835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:45.601944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:45.603068 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:45.635897 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:45.715224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-011765aa-b31e-46a3-b61a-53ed0ae6d13a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Lock "61825815-2fef-44e5-bdb6-4f40ea7e49fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.278s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:45.799131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:45.884721 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998709892999614 future=<Future at 0x743618426a80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:45.887509 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance destroyed successfully.
May 14 04:36:45.888002 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'numa_topology' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:46.078136 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:46.078630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:46.078814 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:46.079392 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:46.079659 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:46.080883 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:46.081096 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2769404f-a1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:46.083168 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:46.088009 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:46.088910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:46.089136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b10fdb93-9d41-47c2-b9ba-3323d32e70e5) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:46.090429 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:46.095059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:46.097057 np0000000747 nova-compute[97971]: INFO os_vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:36:46.101842 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start _get_guest_xml network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:36:46.104476 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:36:46.105679 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-655844742', uuid='ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'), owner=OwnerMeta(userid='a74e809c82bf46ce93759af89887f6b7', username='tempest-AttachVolumeTestJSON-948226058-project-member', projectid='7c56a1dd0473425da8eddafc3d4c27a7', projectname='tempest-AttachVolumeTestJSON-948226058'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733406.1053333) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:36:46.107065 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:36:46.107346 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:36:46.109309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:36:46.109309 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:36:46.109519 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:36:46.109830 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:36:46.110735 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:36:46.111147 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:36:46.111147 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:36:46.111265 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:36:46.111868 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:36:46.111868 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:46.217744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:46.390878 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:46.393309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:46.393469 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:46.393699 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:46.615291 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:46.624688 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:36:46.624853 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:46.625502 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:46.626166 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'pci_devices' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:46.898714 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:46.910727 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:36:46.912031 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:36:46.912345 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Creating image(s)
May 14 04:36:46.912907 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:36:46.913157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Ensure instance console log exists: /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:36:46.913522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:46.913805 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:46.914030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:46.914550 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Start _get_guest_xml network_info=[{"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5a8c87a2-752f-425b-bc5b-0b0900de817a', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4c341c8c-ba1f-4ed6-9b89-faa1384b225a', 'attached_at': '', 'detached_at': '', 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'serial': '89e6be26-61cd-455b-8c67-daba837b8cb5'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:36:46.919382 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:36:46.920917 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1085842456', uuid='4c341c8c-ba1f-4ed6-9b89-faa1384b225a'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733406.9204545) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:36:46.922706 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:36:46.923195 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:36:46.924378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:36:46.924691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:36:46.925670 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:36:46.926103 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:36:46.926373 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:36:46.926565 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:36:46.926823 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:36:46.927007 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:36:46.927210 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:36:46.927476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:36:46.927698 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:36:46.927920 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:36:46.928160 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:36:46.928430 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:36:46.945697 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:36:46.946397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:46.946731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:46.948017 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:46.948378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:36:46.962282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:46.962890 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:46.963361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:46.963549 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:36:46.963937 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:46.964158 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:36:46.977448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:36:46.977448 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:46.983893 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:36:46.983893 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5] added
May 14 04:36:46.991816 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:46.991816 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:36:46.991816 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:36:46.992343 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:36:46.995676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5] added
May 14 04:36:46.995676 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:36:46.995676 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:46.995676 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:46.995676 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:36:46.995676 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:36:46.995676 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:46.995949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:36:46.995949 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:36:46.999636 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:36:47.128037 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:47.128938 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] End _get_guest_xml xml=<domain type="qemu">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <uuid>ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</uuid>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <name>instance-00000033</name>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeTestJSON-server-655844742</nova:name>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:36:46</nova:creationTime>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:user uuid="a74e809c82bf46ce93759af89887f6b7">tempest-AttachVolumeTestJSON-948226058-project-member</nova:user>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:project uuid="7c56a1dd0473425da8eddafc3d4c27a7">tempest-AttachVolumeTestJSON-948226058</nova:project>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         <nova:port uuid="2769404f-a1f4-440a-97f5-692848a35083">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <system>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="serial">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="uuid">ea107286-2cae-47ed-a3ee-a3ad8bf15ae8</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </system>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <os>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </os>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <features>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </features>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   <devices>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk.config"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9c:de:75"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <target dev="tap2769404f-a1"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </interface>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/console.log" append="off"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </serial>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <video>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </video>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </rng>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:   </devices>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]: </domain>
May 14 04:36:47.128938 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:36:47.130983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:47.144666 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:47.251541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:47.252280 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:47.360683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:47.364553 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:47.381760 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:47.572395 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:47.867084 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:47.867496 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:47.972946 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:47.973361 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:36:47.973657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:47.995370 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:36:47.999334 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:36:48.012629 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:36:48.012629 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:36:48.014993 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:36:48.014993 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.032216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.042370 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.051398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.051398 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.051398 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:48.051398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.051398 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.051398 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:48.059767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.059767 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.059767 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:48.059767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.059767 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.059767 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:48.075389 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:48.075951 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:48.076297 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:48.085743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.40.100,3260]
May 14 04:36:48.085743 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.40.100,3260] successful.
May 14 04:36:48.085743 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.086101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:48.086471 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Cannot resize image /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:36:48.086781 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'migration_context' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:48.101855 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.109650 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.50.100,3260]
May 14 04:36:48.109650 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.50.100,3260] successful.
May 14 04:36:48.109650 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.122634 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('7', '-', '-', 0) found on session 130 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:36:48.122634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:36:48.133095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:48.145196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 130 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:36:48.145196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:36:48.153218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.153218 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.153218 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.153218 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.153218 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:48.153432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.153432 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:48.153432 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.153432 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:48.153432 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:48.153708 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:48.153846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:36:48.154432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('8', '-', '-', 0) found on session 131 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:36:48.154562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:36:48.167676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 131 and hctl ['8', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:36:48.599590 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Object Instance<ea107286-2cae-47ed-a3ee-a3ad8bf15ae8> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:48.599590 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:36:48.600694 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:48.601745 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:48.602073 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:36:48.603553 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.603939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:48.604381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:36:48.608187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.608187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8293de9c-b3f9-53a5-9134-c2c6844b1cdb', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:48.612373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.614118 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:48.616281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.618738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.618981 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2769404f-a1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:48.619411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2769404f-a1, col_values=(('qos', UUID('2133a578-3cba-487c-8376-5d5058e0e6c7')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:48.619667 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2769404f-a1, col_values=(('external_ids', {'iface-id': '2769404f-a1f4-440a-97f5-692848a35083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:de:75', 'vm-uuid': 'ea107286-2cae-47ed-a3ee-a3ad8bf15ae8'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:48.625438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.625840 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:48.639386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:48.640719 np0000000747 nova-compute[97971]: INFO os_vif [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:36:48.682858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:48.683085 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:48.683324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:48.683480 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:48.683673 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:48.683840 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fdd53ab6-bed8-4efb-b373-4503b3af4d53 req-1726d990-2261-49f2-b3ec-006903c11757 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received unexpected event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with vm_state active and task_state shelving.
May 14 04:36:48.750225 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance destroyed successfully.
May 14 04:36:48.751067 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'resources' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:49.131426 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.169323 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 131 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:36:49.169643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:36:49.191954 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.229448 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.232561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.253030 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Object Instance<9078c4c9-d972-44b1-843b-2320db6ee10a> lazy-loaded attributes: numa_topology,resources {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:36:49.254010 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymCQWd3Z+7vZw4v/tetdIhFfgL9teebsgfE4tojPxbHFzyJ0esR0KSkptKmGwHM0Rg1VyaCD6nLE+KXDdifjEf7QN5fRih0Y1KsH1JmoRetDNk9mrUEKVYIELVs/sbCg==',key_name='tempest-TestShelveInstance-1575134270',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:36:05Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:06Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:36:49.254223 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:49.254708 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:49.254899 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:36:49.257053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.257053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85da9544-f4, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:49.258067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.260309 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:49.261109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.261109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec6563b8-a981-47bf-94b0-e79e4825699e) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:49.264629 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.265200 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:49.265980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.272287 np0000000747 nova-compute[97971]: INFO os_vif [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4')
May 14 04:36:49.278337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:36:49.278337 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:49.278337 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:36:49.335317 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.489467 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.606772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.612727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.614969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.639444 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:49.766254 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:49.766556 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:49.766757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:49.766900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:49.767013 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:49.767157 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-09e98736-57ac-44e3-bf52-691d9a4a4047 req-a5cd9549-09c0-46d9-9ae1-0c8f081c31d2 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received unexpected event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with vm_state active and task_state shelving.
May 14 04:36:49.985545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 3300000008e9d1cda for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:36:49.994124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:49.994260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000008e9d1cda', 'path': '/dev/dm-0', 'multipath_id': '3300000008e9d1cda'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:49.994391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008e9d1cda', 'path': '/dev/dm-0', 'multipath_id': '3300000008e9d1cda'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:36:50.000866 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.719s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:36:50.002422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:36:50.002422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:36:50.033446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:50.033446 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:50.033446 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:50.033446 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:50.033446 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:36:50.033769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:50.033769 np0000000747 nova-compute[97971]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:36:50.033769 np0000000747 nova-compute[97971]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:50.033769 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:36:50.033769 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:36:50.033922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '131')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:36:50.034062 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '123')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:50.035041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '124')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:36:50.035825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f827ae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'): ({'sdj'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:36:50.036030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Removing multipathed devices sdj, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:36:50.036548 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flush multipath device 3300000002a9f2042 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:36:50.109743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:50.151373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:36:50.201770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:36:50.201770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:36:50.202316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:36:50.214565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:36:50.214842 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:36:50.226790 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Removed pending STOPPED event for ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 due to new event <LifecycleEvent: 1778733410.225576, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Resumed> {{(pid=97971) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 14 04:36:50.227258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance event wait completed in 0 seconds for  {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:36:50.228788 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733410.225576, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:50.228788 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Resumed (Lifecycle Event)
May 14 04:36:50.233829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.236955 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance rebooted successfully.
May 14 04:36:50.265599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260]
May 14 04:36:50.265599 np0000000747 nova-compute[97971]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260] successful.
May 14 04:36:50.265599 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.281676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.294312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.325271 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260]
May 14 04:36:50.325271 np0000000747 nova-compute[97971]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260] successful.
May 14 04:36:50.325271 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.340774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:36:50.342084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:36:50.342084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== disconnect_volume: return (1063ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:50.342084 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:36:50.342084 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deleting instance files /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a_del
May 14 04:36:50.342084 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deletion of /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a_del complete
May 14 04:36:50.512424 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1085842456',display_name='tempest-TestVolumeBootPattern-server-1085842456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1085842456',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-19zne9hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:41Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=4c341c8c-ba1f-4ed6-9b89-faa1384b225a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:36:50.512725 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:50.513368 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:50.514209 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c341c8c-ba1f-4ed6-9b89-faa1384b225a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:50.730933 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:50.733562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:50.763825 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:50.763877 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing instance network info cache due to event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:50.764354 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:50.764772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:50.764970 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:51.017773 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <uuid>4c341c8c-ba1f-4ed6-9b89-faa1384b225a</uuid>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <name>instance-00000038</name>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1085842456</nova:name>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:36:46</nova:creationTime>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         <nova:port uuid="880062a7-7b42-497c-9b21-49595bf5b79b">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <system>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="serial">4c341c8c-ba1f-4ed6-9b89-faa1384b225a</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="uuid">4c341c8c-ba1f-4ed6-9b89-faa1384b225a</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </system>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <os>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </os>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <features>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </features>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   <devices>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/disk.config"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <alias name="ua-89e6be26-61cd-455b-8c67-daba837b8cb5"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <serial>89e6be26-61cd-455b-8c67-daba837b8cb5</serial>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </disk>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:69:4c:8d"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <target dev="tap880062a7-7b"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </interface>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/console.log" append="off"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </serial>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <video>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </video>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </rng>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:   </devices>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]: </domain>
May 14 04:36:51.017773 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Preparing to wait for external event network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1085842456',display_name='tempest-TestVolumeBootPattern-server-1085842456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1085842456',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-19zne9hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:41Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=4c341c8c-ba1f-4ed6-9b89-faa1384b225a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.021939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a438622-f70e-5a89-97e3-52abbf52ffe5', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:51.023036 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.023036 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:51.024195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.027185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.027353 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap880062a7-7b, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:51.027650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap880062a7-7b, col_values=(('qos', UUID('c0ea71b1-94d1-442c-8561-08907436326a')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:51.027779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap880062a7-7b, col_values=(('external_ids', {'iface-id': '880062a7-7b42-497c-9b21-49595bf5b79b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:4c:8d', 'vm-uuid': '4c341c8c-ba1f-4ed6-9b89-faa1384b225a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:36:51.028677 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.029799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:36:51.037763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.037763 np0000000747 nova-compute[97971]: INFO os_vif [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b')
May 14 04:36:51.219439 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:51.236380 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:36:51.239710 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733411.2364647, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:51.239879 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Started (Lifecycle Event)
May 14 04:36:51.269253 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:51.589049 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:51.742381 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:51.745246 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:51.749425 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updated VIF entry in instance network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:36:51.749567 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": null, "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap85da9544-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:51.755488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:51.755488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:51.755488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:9c:de:75, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:36:51.755488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5ab66d81-d11a-4d8a-84cd-5d75c4bde51e tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:52.079033 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Deleted allocations for instance 9078c4c9-d972-44b1-843b-2320db6ee10a
May 14 04:36:52.248144 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] During sync_power_state the instance has a pending task (powering-on). Skip.
May 14 04:36:52.251782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3384533a-804b-4bf5-8d39-84c6cfb6ab5b req-d4e88819-659d-47f2-9db6-2693ec231e28 service nova] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:52.554281 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:52.554382 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:36:52.554485 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:69:4c:8d, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:36:52.554845 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Using config drive
May 14 04:36:52.585458 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:52.585654 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:52.620500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:52.620684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:52.819081 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:52.819391 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:53.061017 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:53.122731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:36:53.212371 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Creating config drive at /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/disk.config
May 14 04:36:53.216967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpck04ahj8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:53.278451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpck04ahj8" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:53.323533 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:53.678935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:53.692662 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:53.732933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:53.799466 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:53.830747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.245s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:53.832953 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:53.840441 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:36:53.840914 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Claim successful on node np0000000747
May 14 04:36:53.995446 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:53.996556 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:53.998312 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:54.017572 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:54.336399 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6b0d4d9c-4012-4fb7-b26a-62d2e9a21473 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.790s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:54.364911 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:54.365172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:54.365372 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Unshelving
May 14 04:36:54.430101 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733414.4276912, 4c341c8c-ba1f-4ed6-9b89-faa1384b225a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:54.430413 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] VM Started (Lifecycle Event)
May 14 04:36:54.933703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:54.938455 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733414.9381135, 4c341c8c-ba1f-4ed6-9b89-faa1384b225a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:54.938630 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] VM Paused (Lifecycle Event)
May 14 04:36:55.050082 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00039481400017393753 future=<Future at 0x7436184f4da0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.050198 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.050360 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.22556522700006099 future=<Future at 0x743618384a40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.050418 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=0.22548077999999805 future=<Future at 0x743618384a40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.124804 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:55.125001 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:55.276397 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00044608500002141227 future=<Future at 0x743618384a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.276548 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.276686 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.6066801449997 future=<Future at 0x743618426a80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.276827 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.606510068999796 future=<Future at 0x743618426a80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:36:55.277228 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733400.2758307, 61825815-2fef-44e5-bdb6-4f40ea7e49fe => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:55.277442 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] VM Stopped (Lifecycle Event)
May 14 04:36:55.374467 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Booting with volume 3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 at /dev/vda
May 14 04:36:55.433251 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:36:55.441366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:55.445421 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:55.449978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:36:55.479524 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:55.512086 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:55.512635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:55.513375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:55.513519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:55.513688 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:55.513820 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-67a465dd-5704-42bc-ae8b-d732e7efdcf8 req-d26afb03-8661-4dd6-a699-27bfaa1ab652 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state active and task_state None.
May 14 04:36:55.531516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:36:55.532015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:36:55.541041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:36:55.542097 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe6f:3711', 'fe80::74de:beff:fe87:e3c8', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:fe69:4c8d', 'fe80::b8c1:aff:fefc:4b25'] 
May 14 04:36:55.542288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:36:55.542413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:36:55.542690 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:36:55.542908 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating existing volume attachment record: e1951fa4-090b-4799-8c5e-1ced817bcd9b {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:36:55.627955 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:36:55.780634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 61825815-2fef-44e5-bdb6-4f40ea7e49fe] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:55.948441 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:36:56.029256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:56.137679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.307s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:56.138125 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:36:56.224930 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:36:56.644117 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:36:56.644117 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:36:56.644509 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:56.646600 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:56.716356 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587fcb0c08cf47d386df9d9c088cb0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e458cafac3d48e99410f3bdfd372b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:36:57.145179 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:36:57.193178 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Successfully created port: 09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:36:57.218648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:57.218859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:57.220253 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'pci_requests' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:57.648577 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:36:57.685812 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Successfully updated port: 09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:36:57.723387 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'numa_topology' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:36:57.761195 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-changed-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:57.761640 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Refreshing instance network info cache due to event network-changed-09443db9-0c94-4ca9-aa5d-80bb0f290fd4. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:36:57.761850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] Acquiring lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:57.761994 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] Acquired lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:57.762215 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Refreshing network info cache for port 09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:36:57.813148 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:57.813377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:57.813577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:57.813771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:57.814186 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:57.814186 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received unexpected event network-vif-plugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with vm_state active and task_state None.
May 14 04:36:57.814321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:57.814461 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:57.814712 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:57.814896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:57.815102 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Processing event network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:36:57.815302 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:36:57.815517 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:57.815663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:57.815839 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:57.817337 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:36:57.817337 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] No waiting events found dispatching network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:36:57.817337 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-1565bfb3-5d4b-4b98-9ea2-58c8545c9d3a req-905d36b6-c3f9-455e-9ad7-abdfc9b71ce4 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received unexpected event network-vif-plugged-880062a7-7b42-497c-9b21-49595bf5b79b for instance with vm_state building and task_state spawning.
May 14 04:36:57.823248 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733417.8229108, 4c341c8c-ba1f-4ed6-9b89-faa1384b225a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:36:57.823571 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:36:57.823990 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] VM Resumed (Lifecycle Event)
May 14 04:36:57.831414 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance spawned successfully.
May 14 04:36:57.831639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:36:58.191483 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:36:58.227364 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:36:58.227364 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Claim successful on node np0000000747
May 14 04:36:58.265654 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:58.329848 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:58.331363 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:36:58.344200 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.347474 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:36:58.349296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.349946 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.350324 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.350645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.351033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:36:58.503626 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:36:58.669820 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:36:58.671142 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:36:58.671142 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Creating image(s)
May 14 04:36:58.672056 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:58.672056 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:58.672279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:58.673516 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:58.676228 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:58.677584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:58.789511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.112s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:58.789942 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:58.790453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:58.790937 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:58.793581 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:36:58.793966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:58.836634 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:36:58.861603 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Took 11.95 seconds to spawn the instance on the hypervisor.
May 14 04:36:58.861765 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:36:58.880875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:58.881876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:58.948503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk 1073741824" returned: 0 in 0.067s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:58.948686 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:58.949040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:59.006273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0ed61ef4-0804-4afe-a087-68a76934fd81 req-5c4583dd-0221-4181-9b3c-a4e1c3c474ed service nova] Releasing lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:36:59.007058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquired lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:36:59.007999 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:36:59.068553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.119s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:59.068987 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:36:59.069284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:36:59.163449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:36:59.163859 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Cannot resize image /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:36:59.164369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:36:59.164568 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Ensure instance console log exists: /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:36:59.165014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:36:59.165299 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:36:59.165666 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:59.372565 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Took 22.59 seconds to build instance.
May 14 04:36:59.600282 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:36:59.670057 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:36:59.670411 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:36:59.788868 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:36:59.874360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-60042978-98eb-4096-bd7b-4294eee0ec13 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.094s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:36:59.927091 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating instance_info_cache with network_info: [{"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:00.173092 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:00.430244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Releasing lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:00.430631 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance network_info: |[{"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:37:00.432451 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Start _get_guest_xml network_info=[{"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:37:00.434682 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:00.435733 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1451884945', uuid='f6476b7f-acf4-4195-84a2-dfa8058b03a2'), owner=OwnerMeta(userid='587fcb0c08cf47d386df9d9c088cb0fd', username='tempest-TestEncryptedCinderVolumes-1204475822-project-member', projectid='8e458cafac3d48e99410f3bdfd372b6e', projectname='tempest-TestEncryptedCinderVolumes-1204475822'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733420.4354217) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:37:00.436685 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:37:00.437003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:37:00.437873 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:37:00.438039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:37:00.438937 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:37:00.439224 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:37:00.439358 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:37:00.439447 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:37:00.439556 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:37:00.439649 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:37:00.439747 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:37:00.439873 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:37:00.439969 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:37:00.440069 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:37:00.440193 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:37:00.440351 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:37:00.451272 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1451884945',display_name='tempest-TestEncryptedCinderVolumes-server-1451884945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1451884945',id=57,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI+3yy3bCyumK6Ml9UqVypyrsGrNUzGCeUN/d+HCi/Qyf5o8B5bP4+SYQNhb5GiOuVaL3WpmPsr1ANosy1B1rYsn73fEzsNmJAxFd8WJ+deZ+dTo9dc6mUK167k+euu7Q==',key_name='tempest-keypair-1807086439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-beh00a9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=f6476b7f-acf4-4195-84a2-dfa8058b03a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:37:00.451483 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:00.452028 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:00.452594 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'pci_devices' on Instance uuid f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:00.455239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:00.455239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:00.455239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:00.455239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:00.455239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:00.456389 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Terminating instance
May 14 04:37:00.681531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.463s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:00.681928 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:00.806875 np0000000747 nova-compute[97971]: INFO nova.network.neutron [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating port 85da9544-f46c-4f84-add3-d8638cee4eee with attributes {'binding:host_id': 'np0000000747', 'device_owner': 'compute:nova'}
May 14 04:37:00.883833 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004480110001168214 future=<Future at 0x743618426a80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:00.884403 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733405.883247, 9078c4c9-d972-44b1-843b-2320db6ee10a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:00.884549 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:00.884750 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Stopped (Lifecycle Event)
May 14 04:37:00.957331 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] End _get_guest_xml xml=<domain type="qemu">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <uuid>f6476b7f-acf4-4195-84a2-dfa8058b03a2</uuid>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <name>instance-00000039</name>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1451884945</nova:name>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:37:00</nova:creationTime>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:user uuid="587fcb0c08cf47d386df9d9c088cb0fd">tempest-TestEncryptedCinderVolumes-1204475822-project-member</nova:user>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:project uuid="8e458cafac3d48e99410f3bdfd372b6e">tempest-TestEncryptedCinderVolumes-1204475822</nova:project>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         <nova:port uuid="09443db9-0c94-4ca9-aa5d-80bb0f290fd4">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <system>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="serial">f6476b7f-acf4-4195-84a2-dfa8058b03a2</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="uuid">f6476b7f-acf4-4195-84a2-dfa8058b03a2</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </system>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <os>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </os>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <features>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </features>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   <devices>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.config"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ac:93:f9"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <target dev="tap09443db9-0c"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </interface>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/console.log" append="off"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </serial>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <video>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </video>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </rng>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:   </devices>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]: </domain>
May 14 04:37:00.957331 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Preparing to wait for external event network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1451884945',display_name='tempest-TestEncryptedCinderVolumes-server-1451884945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1451884945',id=57,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI+3yy3bCyumK6Ml9UqVypyrsGrNUzGCeUN/d+HCi/Qyf5o8B5bP4+SYQNhb5GiOuVaL3WpmPsr1ANosy1B1rYsn73fEzsNmJAxFd8WJ+deZ+dTo9dc6mUK167k+euu7Q==',key_name='tempest-keypair-1807086439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-beh00a9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=f6476b7f-acf4-4195-84a2-dfa8058b03a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:00.960232 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:37:00.962432 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:37:00.963996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.964215 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:00.964589 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:37:00.965501 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.965783 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7561202b-569a-5ae1-9240-23b2fbc06982', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:00.966634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.967516 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:00.982581 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.989205 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.989399 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09443db9-0c, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:00.989842 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09443db9-0c, col_values=(('qos', UUID('ebcd686e-26fc-4a0b-beca-bc937d10a8ef')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:00.990075 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09443db9-0c, col_values=(('external_ids', {'iface-id': '09443db9-0c94-4ca9-aa5d-80bb0f290fd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:93:f9', 'vm-uuid': 'f6476b7f-acf4-4195-84a2-dfa8058b03a2'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:00.990979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:00.992272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:01.019511 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.049701 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.050756 np0000000747 nova-compute[97971]: INFO os_vif [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c')
May 14 04:37:01.062461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.141455 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:01.141655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:01.141798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:01.141903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:01.142004 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] No waiting events found dispatching network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:01.142141 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4c33fd9b-0341-40ba-9d98-af18ac74341a req-cdfda16c-2203-42dd-9470-19c470b51638 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:01.225522 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.307686 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.319218 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.328684 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999629902999914 future=<Future at 0x74361bf880e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:01.328684 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999055265000152 future=<Future at 0x74361bf880e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:01.328904 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998886141000185 future=<Future at 0x74361bf880e0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:01.332689 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Instance destroyed successfully.
May 14 04:37:01.333209 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 4c341c8c-ba1f-4ed6-9b89-faa1384b225a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:01.374272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:01.374272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:01.374272 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:37:01.390456 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:01.445864 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:01.447053 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing instance network info cache due to event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:01.447229 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:01.837394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1085842456',display_name='tempest-TestVolumeBootPattern-server-1085842456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1085842456',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:36:58Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-19zne9hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:59Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=4c341c8c-ba1f-4ed6-9b89-faa1384b225a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:37:01.838006 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "880062a7-7b42-497c-9b21-49595bf5b79b", "address": "fa:16:3e:69:4c:8d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap880062a7-7b", "ovs_interfaceid": "880062a7-7b42-497c-9b21-49595bf5b79b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:01.838153 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:01.838413 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:37:01.842823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.842823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap880062a7-7b, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:01.844387 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:01.849910 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.852440 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.852440 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0ea71b1-94d1-442c-8561-08907436326a) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:01.853572 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:01.859001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:01.862312 np0000000747 nova-compute[97971]: INFO os_vif [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:4c:8d,bridge_name='br-int',has_traffic_filtering=True,id=880062a7-7b42-497c-9b21-49595bf5b79b,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap880062a7-7b')
May 14 04:37:01.864841 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:37:01.865250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:01.865423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:01.865884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:01.866276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89e6be26-61cd-455b-8c67-daba837b8cb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:37:01.866454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:37:01.877737 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:01.900334 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:37:01.900334 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:37:01.900334 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:01.900513 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:37:01.900513 np0000000747 nova-compute[97971]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5 (non-flash)
May 14 04:37:01.900513 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:01.900659 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '131')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:37:01.900811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '130')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:01.901847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5', '131')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:01.902684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f845a5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:37:01.902930 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:37:01.903207 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 3300000008e9d1cda {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:37:01.961120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:02.011859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:02.074104 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:37:02.074326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:37:02.075058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:37:02.090868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:37:02.092066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:37:02.104424 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.136130 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.40.100,3260]
May 14 04:37:02.136130 np0000000747 nova-compute[97971]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.40.100,3260] successful.
May 14 04:37:02.136130 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.153598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.164929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.199864 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.50.100,3260]
May 14 04:37:02.199864 np0000000747 nova-compute[97971]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-89e6be26-61cd-455b-8c67-daba837b8cb5, portal: 192.168.50.100,3260] successful.
May 14 04:37:02.199864 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.217690 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:02.217880 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:02.217993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (352ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:02.218098 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:37:02.218351 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Deleting instance files /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a_del
May 14 04:37:02.218828 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Deletion of /opt/stack/data/nova/instances/4c341c8c-ba1f-4ed6-9b89-faa1384b225a_del complete
May 14 04:37:02.271768 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:02.438755 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:02.572911 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:02.573041 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:02.573158 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:ac:93:f9, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:02.573541 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Using config drive
May 14 04:37:02.728522 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Took 1.77 seconds to destroy the instance on the hypervisor.
May 14 04:37:02.732294 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:37:02.734901 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:37:02.734901 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:37:02.734901 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:02.839305 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:02.940999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:02.942314 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:02.942493 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:02.943963 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:37:02.943963 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating image(s)
May 14 04:37:02.944299 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:37:02.944450 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Ensure instance console log exists: /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:37:02.944708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:02.944888 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:02.945019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:02.945503 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start _get_guest_xml network_info=[{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1951fa4-090b-4799-8c5e-1ced817bcd9b', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9078c4c9-d972-44b1-843b-2320db6ee10a', 'attached_at': '', 'detached_at': '', 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'serial': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:37:02.947938 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:02.949125 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-2058248421', uuid='9078c4c9-d972-44b1-843b-2320db6ee10a'), owner=OwnerMeta(userid='bdf7a94492f3476fb201e51478145d07', username='tempest-TestShelveInstance-710703435-project-member', projectid='582a6b9df4fc4204ba57f289f810d031', projectname='tempest-TestShelveInstance-710703435'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733422.9488018) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:37:02.950420 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:37:02.950644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:37:02.953064 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:37:02.953337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:37:02.954306 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:37:02.954696 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:37:02.954912 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:37:02.955081 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:37:02.955311 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:37:02.955506 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:37:02.955703 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:37:02.955961 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:37:02.956123 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:37:02.956305 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:37:02.956465 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:37:02.956643 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:37:02.957039 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:03.079287 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:03.197579 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:03.198672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] Acquiring lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:03.198672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:03.198672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:03.198672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] No waiting events found dispatching network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:03.198672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf1c3c4c-6344-4cce-8d5e-aecb9e9e27c3 req-7395d5b6-21ee-4349-90fb-bbd9f8328ea5 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-unplugged-880062a7-7b42-497c-9b21-49595bf5b79b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:03.215700 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Creating config drive at /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.config
May 14 04:37:03.219540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkty7i8zl {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:03.272850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkty7i8zl" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:03.447043 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:03.459052 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Object Instance<9078c4c9-d972-44b1-843b-2320db6ee10a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:37:03.470001 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:37:03.470001 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:03.470001 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:03.470573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:03.470873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:37:03.484953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:03.487212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:03.487212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:03.487212 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:03.487212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:03.487212 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:03.499877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:03.499877 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:03.505295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:03.505295 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:03.523313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475] added
May 14 04:37:03.523313 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:03.523313 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:03.523313 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:03.523313 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:03.523313 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:03.523313 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:03.523532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:03.523695 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:03.523891 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:03.530560 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d6d6b8fb-9aa9-448a-90e9-f3c436523a8e req-3850e454-16ee-4022-9c05-21a7a04a6022 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Received event network-vif-deleted-880062a7-7b42-497c-9b21-49595bf5b79b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:03.530720 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d6d6b8fb-9aa9-448a-90e9-f3c436523a8e req-3850e454-16ee-4022-9c05-21a7a04a6022 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Neutron deleted interface 880062a7-7b42-497c-9b21-49595bf5b79b; detaching it from the instance and deleting it from the info cache
May 14 04:37:03.530859 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d6d6b8fb-9aa9-448a-90e9-f3c436523a8e req-3850e454-16ee-4022-9c05-21a7a04a6022 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:03.532884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475] added
May 14 04:37:03.532884 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:03.532884 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:03.532884 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:03.532884 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:03.532884 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:03.532884 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:03.533091 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:03.533154 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0471(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:03.533326 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:03.573704 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:03.698407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:03.727840 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:03.732313 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:03.816166 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:03.833937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:04.001424 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updated VIF entry in instance network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:04.002950 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:04.039161 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d6d6b8fb-9aa9-448a-90e9-f3c436523a8e req-3850e454-16ee-4022-9c05-21a7a04a6022 service nova] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Detach interface failed, port_id=880062a7-7b42-497c-9b21-49595bf5b79b, reason: Instance 4c341c8c-ba1f-4ed6-9b89-faa1384b225a could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:37:04.043140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:04.046596 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:04.049209 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:04.075585 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:04.076007 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Took 1.34 seconds to deallocate network for instance.
May 14 04:37:04.471934 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733424.471517, f6476b7f-acf4-4195-84a2-dfa8058b03a2 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:04.472085 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] VM Started (Lifecycle Event)
May 14 04:37:04.504318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fd150b3-680a-4752-a952-b639d8cb7796 req-9b46c846-c08a-4c15-b425-0d742af1848c service nova] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:04.524322 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:04.533766 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:04.538825 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:04.538825 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:04.545366 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:04.545366 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.552600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.557508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.566735 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:37:04.566735 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:04.566989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:37:04.566989 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:04.566989 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:37:04.566989 np0000000747 nova-compute[97971]: 
May 14 04:37:04.568558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:37:04.568558 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:04.568734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:37:04.568734 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:04.568911 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:37:04.568911 np0000000747 nova-compute[97971]: 
May 14 04:37:04.592845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260]
May 14 04:37:04.592845 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260] successful.
May 14 04:37:04.592845 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.597535 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260]
May 14 04:37:04.597535 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260] successful.
May 14 04:37:04.597535 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.605788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.610526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:04.622192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.622192 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.622192 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:04.622443 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.622443 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.622443 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:04.622931 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:04.623179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:04.624166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.624166 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.624166 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:04.624166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.624166 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:04.624166 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:04.624565 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:04.624951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:04.625345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] HCTL ('7', '-', '-', 0) found on session 132 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:04.625477 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:04.626216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] HCTL ('8', '-', '-', 0) found on session 133 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:04.626216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:04.634948 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:37:04.637075 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Deleting volume: 89e6be26-61cd-455b-8c67-daba837b8cb5 {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:37:04.662995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching for a device in session 132 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:04.662995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:04.662995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Searching for a device in session 133 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:04.662995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:04.974545 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:04.976759 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733424.9764624, f6476b7f-acf4-4195-84a2-dfa8058b03a2 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:04.976905 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] VM Paused (Lifecycle Event)
May 14 04:37:05.189659 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:05.190235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:05.446488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:05.446787 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:05.479424 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:05.481632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:05.486858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:37:05.590261 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:05.590792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:05.590943 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:05.591060 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:05.591226 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Processing event network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:37:05.591358 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:05.591489 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:05.591681 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:05.591794 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:05.591907 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] No waiting events found dispatching network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:05.592025 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-bf571f42-27fa-41c3-bda1-8dede49412cb req-1e5a6cbb-9da8-451c-9bdd-f9ffffaaf844 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received unexpected event network-vif-plugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 for instance with vm_state building and task_state spawning.
May 14 04:37:05.592822 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:37:05.597649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:37:05.599491 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance spawned successfully.
May 14 04:37:05.599677 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:37:05.949669 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:05.984150 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:37:05.984374 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733425.9842105, f6476b7f-acf4-4195-84a2-dfa8058b03a2 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:05.984461 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] VM Resumed (Lifecycle Event)
May 14 04:37:06.106608 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.106814 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.107238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.107532 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.107897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.108174 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:06.229340 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:06.456597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.267s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:06.487158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:06.492525 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:06.503351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Found WWN 3300000002a9f2042 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:37:06.503744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:06.503975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000002a9f2042', 'path': '/dev/dm-0', 'multipath_id': '3300000002a9f2042'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:06.504200 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002a9f2042', 'path': '/dev/dm-0', 'multipath_id': '3300000002a9f2042'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:37:06.512316 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 4c341c8c-ba1f-4ed6-9b89-faa1384b225a
May 14 04:37:06.615523 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Took 7.95 seconds to spawn the instance on the hypervisor.
May 14 04:37:06.615684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:06.854634 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:06.995303 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:37:07.015768 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1575134270',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:36:05Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:55Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:37:07.016021 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:07.016673 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:07.017325 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'pci_devices' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:07.124987 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Took 13.50 seconds to build instance.
May 14 04:37:07.524149 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Object Instance<9078c4c9-d972-44b1-843b-2320db6ee10a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:37:07.525283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df90b251-d8e7-4f77-ad45-32a918242735 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "4c341c8c-ba1f-4ed6-9b89-faa1384b225a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.071s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:07.527057 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] End _get_guest_xml xml=<domain type="qemu">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <uuid>9078c4c9-d972-44b1-843b-2320db6ee10a</uuid>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <name>instance-00000037</name>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestShelveInstance-server-2058248421</nova:name>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:37:02</nova:creationTime>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:user uuid="bdf7a94492f3476fb201e51478145d07">tempest-TestShelveInstance-710703435-project-member</nova:user>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:project uuid="582a6b9df4fc4204ba57f289f810d031">tempest-TestShelveInstance-710703435</nova:project>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         <nova:port uuid="85da9544-f46c-4f84-add3-d8638cee4eee">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <system>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="serial">9078c4c9-d972-44b1-843b-2320db6ee10a</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="uuid">9078c4c9-d972-44b1-843b-2320db6ee10a</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </system>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <os>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </os>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <features>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </features>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   <devices>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <alias name="ua-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <serial>3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475</serial>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:85:84:8a"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <target dev="tap85da9544-f4"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </interface>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/console.log" append="off"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </serial>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <video>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </video>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </rng>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:   </devices>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]: </domain>
May 14 04:37:07.527057 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Preparing to wait for external event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1575134270',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:36:05Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:55Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:37:07.528909 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:07.529215 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:07.529401 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:37:07.529686 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.529946 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:07.530223 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:37:07.534295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.534454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '271efac0-78d2-52a2-aacd-98879114fc01', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:07.542601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.543334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:07.543858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.547884 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.548012 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85da9544-f4, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:07.548274 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85da9544-f4, col_values=(('qos', UUID('a6a84891-2ab3-47a4-8755-f5af52613293')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:07.548420 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85da9544-f4, col_values=(('external_ids', {'iface-id': '85da9544-f46c-4f84-add3-d8638cee4eee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:84:8a', 'vm-uuid': '9078c4c9-d972-44b1-843b-2320db6ee10a'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:07.549066 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.550067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:07.555475 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:07.556116 np0000000747 nova-compute[97971]: INFO os_vif [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4')
May 14 04:37:07.626308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3fc92e57-4d4d-4f16-a1d1-2a199cf55d2e tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:08.444258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-changed-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:08.444368 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Refreshing instance network info cache due to event network-changed-09443db9-0c94-4ca9-aa5d-80bb0f290fd4. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:08.444522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] Acquiring lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:08.444665 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] Acquired lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:08.444810 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Refreshing network info cache for port 09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:08.948633 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:09.085517 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:09.085743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:09.085923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] No VIF found with MAC fa:16:3e:85:84:8a, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:09.086503 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Using config drive
May 14 04:37:09.316396 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:09.443399 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updated VIF entry in instance network info cache for port 09443db9-0c94-4ca9-aa5d-80bb0f290fd4. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:09.443770 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating instance_info_cache with network_info: [{"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:09.594282 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:09.945683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74bc8437-048c-4726-879b-4244e7940dd7 req-334f8b55-61b8-48c2-883f-9500b89cd643 service nova] Releasing lock "refresh_cache-f6476b7f-acf4-4195-84a2-dfa8058b03a2" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:10.097964 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Object Instance<9078c4c9-d972-44b1-843b-2320db6ee10a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:37:10.098332 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'keypairs' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:10.607412 np0000000747 nova-compute[97971]: DEBUG nova.objects.base [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Object Instance<9078c4c9-d972-44b1-843b-2320db6ee10a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=97971) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 14 04:37:10.610585 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:10.739011 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Creating config drive at /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config
May 14 04:37:10.742896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2s4_40z2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:10.802377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2s4_40z2" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:10.861849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.230525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.260297 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.285408 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.289777 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.397868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.521752 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38f72a1c-18ba-448d-80f4-30eead0eb1f2 req-d438ea7e-e6f1-4409-a6a2-ee6af418435b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:11.523083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38f72a1c-18ba-448d-80f4-30eead0eb1f2 req-d438ea7e-e6f1-4409-a6a2-ee6af418435b service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:11.523083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38f72a1c-18ba-448d-80f4-30eead0eb1f2 req-d438ea7e-e6f1-4409-a6a2-ee6af418435b service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:11.523083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-38f72a1c-18ba-448d-80f4-30eead0eb1f2 req-d438ea7e-e6f1-4409-a6a2-ee6af418435b service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:11.523292 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-38f72a1c-18ba-448d-80f4-30eead0eb1f2 req-d438ea7e-e6f1-4409-a6a2-ee6af418435b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Processing event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:37:11.653940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.663742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:11.683817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.157405 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733432.157006, 9078c4c9-d972-44b1-843b-2320db6ee10a => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:12.157537 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Started (Lifecycle Event)
May 14 04:37:12.159375 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:37:12.160856 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:37:12.163682 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance spawned successfully.
May 14 04:37:12.164323 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:12.235050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:12.235522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:12.235522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:12.235522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:12.235522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:12.237873 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Terminating instance
May 14 04:37:12.550506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.662718 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:12.663385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:12.672878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b36eeaf4-19e8-49a7-960a-0dd1b087e8ec tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.308s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:12.740791 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:37:12.767118 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.769890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.795726 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.806834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:12.831963 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.110675 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Instance destroyed successfully.
May 14 04:37:13.111905 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lazy-loading 'resources' on Instance uuid 3186131b-429e-4d79-9dc3-be4059f42fc2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:13.167734 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733433.1667972, 9078c4c9-d972-44b1-843b-2320db6ee10a => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:13.168678 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Paused (Lifecycle Event)
May 14 04:37:13.507903 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:13.600239 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e7f074fe-88b0-4775-9aef-15d6bd75de58 req-d15f11b3-f2a5-45ee-8ed3-fadd6f685d61 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received unexpected event network-vif-plugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with vm_state active and task_state None.
May 14 04:37:13.617643 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1774273441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumeshelvetestjson-server-1774273441',id=54,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFRFfjoV+j/OvoLwium9/rPSNaVA3/SiVgF6zoWfaNnT/MGeygiKGOxBHVj4AZvSTys3p1oKEmkSJdG1rqUDi3DX/4R6jkRlpCBkalPadCRULAfEjSlJ33NYyrixeH1NA==',key_name='tempest-keypair-653108543',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:36:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b66752be38742a38c2a4ef876561d9a',ramdisk_id='',reservation_id='r-vl9fpgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1339972729',owner_user_name='tempest-AttachVolumeShelveTestJSON-1339972729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd917914b2414921963ae67e7a9780f1',uuid=3186131b-429e-4d79-9dc3-be4059f42fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:37:13.617643 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converting VIF {"id": "5138acaa-8641-40f4-8060-53339de07d09", "address": "fa:16:3e:6f:37:11", "network": {"id": "01622f1d-4a9d-4dae-926b-937af821f75d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1626919041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b66752be38742a38c2a4ef876561d9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5138acaa-86", "ovs_interfaceid": "5138acaa-8641-40f4-8060-53339de07d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:13.617643 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:13.617643 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:37:13.618533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.618533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5138acaa-86, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:13.620300 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.621211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:13.622311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.622311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b88d9192-b070-41de-9358-d2864b4d2b4f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:13.623141 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:13.624223 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:13.626196 np0000000747 nova-compute[97971]: INFO os_vif [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:11,bridge_name='br-int',has_traffic_filtering=True,id=5138acaa-8641-40f4-8060-53339de07d09,network=Network(01622f1d-4a9d-4dae-926b-937af821f75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5138acaa-86')
May 14 04:37:13.626572 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Deleting instance files /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2_del
May 14 04:37:13.636919 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Deletion of /opt/stack/data/nova/instances/3186131b-429e-4d79-9dc3-be4059f42fc2_del complete
May 14 04:37:13.672391 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:13.676243 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733433.6759942, 9078c4c9-d972-44b1-843b-2320db6ee10a => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:13.676386 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Resumed (Lifecycle Event)
May 14 04:37:13.770016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:13.770261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:14.052207 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:14.052375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:14.052568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:14.052958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:14.052958 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:14.052958 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c59fec80-beb8-4769-a78a-571807fc5b5c req-0b264f83-2e52-4efc-b7a3-0b8fbe60e466 service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:14.144558 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:37:14.144558 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:37:14.144558 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:37:14.144771 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:37:14.144883 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:14.179340 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:14.181848 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:14.272577 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:37:14.306280 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:14.684790 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.9996346920002 future=<Future at 0x74361849ddf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:14.836987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:14.837631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:14.843787 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:37:14.844439 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Claim successful on node np0000000747
May 14 04:37:15.505134 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:16.007174 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Took 1.86 seconds to deallocate network for instance.
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] Acquiring lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] No waiting events found dispatching network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-unplugged-5138acaa-8641-40f4-8060-53339de07d09 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:16.130703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-420ab087-2f4b-4178-a138-35e1188bf3a6 req-087704f0-e5cc-4d26-ae92-1f3dd3e4992b service nova] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Received event network-vif-deleted-5138acaa-8641-40f4-8060-53339de07d09 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:16.152639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:16.152973 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:16.231552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:16.332060 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0040341139997508435 future=<Future at 0x74361bf880e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:16.332485 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733421.327626, 4c341c8c-ba1f-4ed6-9b89-faa1384b225a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:16.332874 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:16.333063 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] VM Stopped (Lifecycle Event)
May 14 04:37:16.334321 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.350052296000285 future=<Future at 0x74361849ddf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:16.334788 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=13.349676689000262 future=<Future at 0x74361849ddf0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:16.418526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:16.514635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:16.656465 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:16.836842 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4e22e45b-95e7-499f-adcd-89a84edfc043 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 4c341c8c-ba1f-4ed6-9b89-faa1384b225a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:17.163893 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.326s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:17.164387 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:37:17.168114 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.650s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:17.492266 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:17.492574 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:17.673811 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:37:17.674031 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:37:17.674368 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:17.674692 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:17.930490 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:37:17.994961 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:18.178156 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:37:18.502980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.338s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:18.556926 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Deleted allocations for instance 3186131b-429e-4d79-9dc3-be4059f42fc2
May 14 04:37:18.609942 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:18.610525 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:18.611071 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:37:18.623673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:18.682184 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:37:18.888663 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Successfully created port: 6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:37:19.189492 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Booting with volume 73f5393a-089a-4dbc-8a07-af61b13b4748 at /dev/vda
May 14 04:37:19.204920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:19.263186 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:19.274853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:37:19.299361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:19.343479 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:37:19.343805 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:37:19.353797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:37:19.354893 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe85:848a', 'fe80::889a:97ff:feb9:f2c', 'fe80::fc16:3eff:fe9c:de75', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feac:93f9', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:37:19.355067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:37:19.355182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:37:19.355405 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:19.355604 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating existing volume attachment record: a2b29ef6-0a1c-4348-85d9-6d7532046b48 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:37:19.408375 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Successfully updated port: 6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:37:19.466702 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-changed-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:19.467138 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Refreshing instance network info cache due to event network-changed-6ca3b42a-7fad-4170-ae34-fd6393c787f1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:19.467230 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] Acquiring lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:19.467357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] Acquired lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:19.467417 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Refreshing network info cache for port 6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:19.570273 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9e0be18-42aa-4ab3-89e6-53f4116a1730 tempest-AttachVolumeShelveTestJSON-1339972729 tempest-AttachVolumeShelveTestJSON-1339972729-project-member] Lock "3186131b-429e-4d79-9dc3-be4059f42fc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.335s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:19.912833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:19.969814 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:20.051952 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:20.265131 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:20.459328 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:20.459663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:20.459826 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:20.459987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:20.460162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] No waiting events found dispatching network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:20.460343 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-526e979b-7c31-4aef-9889-37c7da7af221 req-f1ed81bf-cdf2-4717-b97f-3b61b774b20b service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received unexpected event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 for instance with vm_state building and task_state block_device_mapping.
May 14 04:37:20.602663 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:20.604323 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:37:20.766975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b4076304-9efd-43ee-bdb4-af350e2892ce req-f19640e4-2cd6-4f98-bf49-1f1b9e0bf573 service nova] Releasing lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:20.767292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:20.767512 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:37:21.234536 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:21.357692 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:21.484364 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:37:21.485528 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:37:21.485755 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Creating image(s)
May 14 04:37:21.486024 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:37:21.486143 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Ensure instance console log exists: /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:37:21.486344 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:21.486500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:21.486606 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:21.520212 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:21.686773 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating instance_info_cache with network_info: [{"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:22.189146 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:22.189146 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance network_info: |[{"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:37:22.189559 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Start _get_guest_xml network_info=[{"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a2b29ef6-0a1c-4348-85d9-6d7532046b48', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2129e698-f081-4a1b-ab59-fe36409dfe71', 'attached_at': '', 'detached_at': '', 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'serial': '73f5393a-089a-4dbc-8a07-af61b13b4748'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:37:22.193151 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:22.194287 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1740017924', uuid='2129e698-f081-4a1b-ab59-fe36409dfe71'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733442.1939676) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:37:22.195348 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:37:22.195780 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:37:22.196527 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:37:22.196758 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:37:22.197637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:37:22.197964 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:37:22.198211 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:37:22.198371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:37:22.198551 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:37:22.198732 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:37:22.198904 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:37:22.199149 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:37:22.199367 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:37:22.199550 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:37:22.199750 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:37:22.199981 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:37:22.210486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:37:22.210837 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:22.211027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:22.211482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:22.211731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:37:22.223389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:22.223982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:22.224380 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:22.224582 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:22.225085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:22.225281 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:22.235509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:22.235509 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:22.240391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:22.240391 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:22.245638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748] added
May 14 04:37:22.245638 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:22.245638 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:22.245638 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:22.245638 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:22.245638 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:22.245638 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:22.245842 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:22.246008 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0214(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:22.246156 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:22.249994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748] added
May 14 04:37:22.249994 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:22.249994 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:22.249994 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:22.249994 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:22.249994 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:22.249994 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:22.250200 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:22.250310 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:22.250471 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:22.610038 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:22.610583 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:23.116357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:23.116357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:23.116357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:23.116357 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:37:23.246636 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:23.250958 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:23.261371 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:23.261371 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:23.265491 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:23.265491 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.275973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.283524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.291381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.291381 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.291381 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:23.291863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.291863 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.291863 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:23.299235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.299235 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.299235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:23.299235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.299235 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.299235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:23.328240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.40.100,3260]
May 14 04:37:23.328240 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.40.100,3260] successful.
May 14 04:37:23.328240 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.341926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.348774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.50.100,3260]
May 14 04:37:23.348774 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.50.100,3260] successful.
May 14 04:37:23.348774 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.360237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:23.366606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.366606 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.366606 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.366606 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.366606 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:23.367037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.367037 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.367037 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.367037 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.367037 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:23.367037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:23.367429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:23.367929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('9', '-', '-', 0) found on session 134 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:23.367929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:23.376571 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('10', '-', '-', 0) found on session 135 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:23.376571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:23.388935 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 134 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:23.388935 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:23.394787 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 135 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:23.395499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:23.625390 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:24.140310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:37:24.140769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:24.225582 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:37:24.237552 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:24.238107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:24.324965 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:24.343148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:24.347071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:24.441494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:24.442017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:24.550824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:24.554974 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:24.555999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:24.621740 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:24.622118 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13188MB free_disk=72.76020431518555GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:37:24.622247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:24.622516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:25.241365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 330000000d20de2e3 for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:37:25.242016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:25.242283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000d20de2e3', 'path': '/dev/dm-3', 'multipath_id': '330000000d20de2e3'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:25.242486 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d20de2e3', 'path': '/dev/dm-3', 'multipath_id': '330000000d20de2e3'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:37:25.682840 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:37:25.682953 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:37:25.683077 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 9078c4c9-d972-44b1-843b-2320db6ee10a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:37:25.683164 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 2129e698-f081-4a1b-ab59-fe36409dfe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:37:25.683326 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:37:25.683445 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:37:24 up 37 min,  2 users,  load average: 5.77, 7.52, 5.29\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_7c56a1dd0473425da8eddafc3d4c27a7': '1', 'io_workload': '1', 'num_proj_582a6b9df4fc4204ba57f289f810d031': '1', 'num_proj_8e458cafac3d48e99410f3bdfd372b6e': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:37:25.748760 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-volume-backed-server-1740017924',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaujoJQmNCT0cYSSVsyJmc6z1NsIUnsOlAUG/a4tm7VueixmNo7Y7ALH2EAP/rmO06qPxaPCOqaFz5mupwp1i1l0EB+pq8FwLyPAI+GQvc9p+PsP4zTO0ohrpPOgHWCoA==',key_name='tempest-keypair-1014158341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-67lv1rpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=2129e698-f081-4a1b-ab59-fe36409dfe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:37:25.748932 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:25.749494 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:25.750149 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 2129e698-f081-4a1b-ab59-fe36409dfe71 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:25.889359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:25.889585 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:26.235412 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.253525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] End _get_guest_xml xml=<domain type="qemu">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <uuid>2129e698-f081-4a1b-ab59-fe36409dfe71</uuid>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <name>instance-0000003a</name>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1740017924</nova:name>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:37:22</nova:creationTime>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         <nova:port uuid="6ca3b42a-7fad-4170-ae34-fd6393c787f1">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <system>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="serial">2129e698-f081-4a1b-ab59-fe36409dfe71</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="uuid">2129e698-f081-4a1b-ab59-fe36409dfe71</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </system>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <os>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </os>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <features>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </features>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   <devices>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/disk.config"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <alias name="ua-73f5393a-089a-4dbc-8a07-af61b13b4748"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-3"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <serial>73f5393a-089a-4dbc-8a07-af61b13b4748</serial>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:1e:8d:d5"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <target dev="tap6ca3b42a-7f"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </interface>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/console.log" append="off"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </serial>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <video>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </video>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </rng>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:   </devices>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]: </domain>
May 14 04:37:26.253525 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Preparing to wait for external event network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-volume-backed-server-1740017924',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaujoJQmNCT0cYSSVsyJmc6z1NsIUnsOlAUG/a4tm7VueixmNo7Y7ALH2EAP/rmO06qPxaPCOqaFz5mupwp1i1l0EB+pq8FwLyPAI+GQvc9p+PsP4zTO0ohrpPOgHWCoA==',key_name='tempest-keypair-1014158341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-67lv1rpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=2129e698-f081-4a1b-ab59-fe36409dfe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.256921 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:26.257453 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:37:26.257797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.257947 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2219fe74-7707-5b21-b370-2d800874b000', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:26.258709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.259344 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:26.260511 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.262118 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.262256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca3b42a-7f, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:26.262527 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca3b42a-7f, col_values=(('qos', UUID('cb109773-a2bf-441d-9914-35249484f407')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:26.262700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca3b42a-7f, col_values=(('external_ids', {'iface-id': '6ca3b42a-7fad-4170-ae34-fd6393c787f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:8d:d5', 'vm-uuid': '2129e698-f081-4a1b-ab59-fe36409dfe71'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:26.263461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.265372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:26.269703 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:26.270217 np0000000747 nova-compute[97971]: INFO os_vif [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f')
May 14 04:37:26.395279 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:26.902677 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:37:26.902837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.280s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:26.903098 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:26.903214 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 04:37:27.405086 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] There are 0 instances to clean {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 04:37:27.405505 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:27.405587 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 04:37:27.785095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:27.785203 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:27.785261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:1e:8d:d5, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:27.785596 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Using config drive
May 14 04:37:27.907659 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:37:28.291878 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:28.422260 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Creating config drive at /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/disk.config
May 14 04:37:28.426082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5vognc9s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:28.477408 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5vognc9s" returned: 0 in 0.051s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:28.887979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:28.914323 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:28.916176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:28.986464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:29.100291 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8fd06503-8b68-412f-b23a-4a1987087cec req-c61f4a5c-5c3e-477b-b90f-e3d922c5da09 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:29.100594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8fd06503-8b68-412f-b23a-4a1987087cec req-c61f4a5c-5c3e-477b-b90f-e3d922c5da09 service nova] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:29.102062 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8fd06503-8b68-412f-b23a-4a1987087cec req-c61f4a5c-5c3e-477b-b90f-e3d922c5da09 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:29.102254 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8fd06503-8b68-412f-b23a-4a1987087cec req-c61f4a5c-5c3e-477b-b90f-e3d922c5da09 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:29.102427 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8fd06503-8b68-412f-b23a-4a1987087cec req-c61f4a5c-5c3e-477b-b90f-e3d922c5da09 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Processing event network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:37:29.176415 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:29.178199 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:29.203394 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:29.610237 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:29.610564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:29.610564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:29.610703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:29.610819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:29.613575 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Terminating instance
May 14 04:37:29.621669 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733449.6212885, 2129e698-f081-4a1b-ab59-fe36409dfe71 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:29.622154 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:37:29.622303 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] VM Started (Lifecycle Event)
May 14 04:37:29.624669 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:37:29.630364 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance spawned successfully.
May 14 04:37:29.630711 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:37:29.684839 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00041788899989114725 future=<Future at 0x74361849ddf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:29.685988 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] Emitting event <LifecycleEvent: 1778733434.6842985, 3186131b-429e-4d79-9dc3-be4059f42fc2 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:29.686374 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:29.686716 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] VM Stopped (Lifecycle Event)
May 14 04:37:29.907474 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:29.907718 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:29.907880 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:29.908028 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:37:29.908269 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.70 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:37:30.120060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:37:30.126040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:30.129091 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:30.142725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.143746 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.152864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:30.166940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.177001 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.190738 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f5c1c67-56de-4616-87f6-8488b189662a tempest-VolumesBackupsTest-1649149288 tempest-VolumesBackupsTest-1649149288-project-member] [instance: 3186131b-429e-4d79-9dc3-be4059f42fc2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:30.203126 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:30.312633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e2da92dc-c83a-4352-a169-5324ee5c6128 req-d7f8f265-38b8-44d2-86d6-3554abb98124 service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:30.481595 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Instance destroyed successfully.
May 14 04:37:30.482481 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'resources' on Instance uuid ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:30.610273 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:37:30.631885 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:37:30.632234 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733450.6320207, 2129e698-f081-4a1b-ab59-fe36409dfe71 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:30.632494 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] VM Paused (Lifecycle Event)
May 14 04:37:30.657106 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Took 9.17 seconds to spawn the instance on the hypervisor.
May 14 04:37:30.657106 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:30.985514 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-655844742',display_name='tempest-AttachVolumeTestJSON-server-655844742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-655844742',id=51,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkUVSe0166Sgh5mTJTnCi8iU/rGPGp0lznzDgX4rRQ6Ba9tmB6lVkb+Swo7QHas4684929QPFWJMhZvNOn8PQG+lL55EtPUHQU8QfWEi3lbC91Yp1wowZdHJImP7lXaFQ==',key_name='tempest-keypair-1551372299',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:34:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-54le9ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=ea107286-2cae-47ed-a3ee-a3ad8bf15ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:37:30.985803 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "2769404f-a1f4-440a-97f5-692848a35083", "address": "fa:16:3e:9c:de:75", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2769404f-a1", "ovs_interfaceid": "2769404f-a1f4-440a-97f5-692848a35083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:30.986657 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:30.986992 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:37:30.988600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.988824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2769404f-a1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:30.990410 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.991727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:30.992363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:30.992484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2133a578-3cba-487c-8376-5d5058e0e6c7) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:30.993855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:30.995994 np0000000747 nova-compute[97971]: INFO os_vif [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:de:75,bridge_name='br-int',has_traffic_filtering=True,id=2769404f-a1f4-440a-97f5-692848a35083,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2769404f-a1')
May 14 04:37:30.996283 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Deleting instance files /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8_del
May 14 04:37:30.997006 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Deletion of /opt/stack/data/nova/instances/ea107286-2cae-47ed-a3ee-a3ad8bf15ae8_del complete
May 14 04:37:31.112741 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:37:31.134607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:31.136635 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733451.1364412, 2129e698-f081-4a1b-ab59-fe36409dfe71 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:31.136744 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] VM Resumed (Lifecycle Event)
May 14 04:37:31.166214 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Took 16.39 seconds to build instance.
May 14 04:37:31.174488 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:31.174678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:31.174812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:31.174997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:31.178635 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] No waiting events found dispatching network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:31.178635 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f5e6fd21-0984-4b08-a562-452e9f9cd08c req-3f67e9a0-0044-4afd-b33e-efe9c0efb233 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received unexpected event network-vif-plugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 for instance with vm_state active and task_state None.
May 14 04:37:31.237392 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:31.504014 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 04:37:31.504621 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:37:31.505131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:37:31.505435 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:37:31.505806 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:31.562420 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:31.638847 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:31.647051 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:31.667865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.898s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:32.150227 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99970883900005 future=<Future at 0x7435f8565760 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:32.150715 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99927158699984 future=<Future at 0x7435f8565760 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:32.151032 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998879489000046 future=<Future at 0x7435f8565760 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:32.375792 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:32.376172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] Acquiring lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:32.376479 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:32.376662 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:32.376790 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] No waiting events found dispatching network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:32.377040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-unplugged-2769404f-a1f4-440a-97f5-692848a35083 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:32.377196 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Received event network-vif-deleted-2769404f-a1f4-440a-97f5-692848a35083 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:32.377196 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Neutron deleted interface 2769404f-a1f4-440a-97f5-692848a35083; detaching it from the instance and deleting it from the info cache
May 14 04:37:32.377384 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:32.461000 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:32.523983 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-changed-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:32.524178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Refreshing instance network info cache due to event network-changed-6ca3b42a-7fad-4170-ae34-fd6393c787f1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:32.524387 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] Acquiring lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:32.524510 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] Acquired lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:32.524751 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Refreshing network info cache for port 6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:32.881444 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3714b68d-ac6b-494c-a86f-66527f46c41a req-45a53bb9-24a3-4bd8-ae8c-86ca71427b7b service nova] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Detach interface failed, port_id=2769404f-a1f4-440a-97f5-692848a35083, reason: Instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:37:32.962899 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Took 1.46 seconds to deallocate network for instance.
May 14 04:37:33.022816 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:33.023020 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:33.029512 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:33.347638 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:33.471015 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:33.471201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:33.495727 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updated VIF entry in instance network info cache for port 6ca3b42a-7fad-4170-ae34-fd6393c787f1. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:33.496105 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating instance_info_cache with network_info: [{"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:33.524635 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:37:33.661080 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Refreshing inventories for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 04:37:33.706228 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Updating ProviderTree inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 04:37:33.706415 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:37:33.754239 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Refreshing aggregate associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, aggregates: None {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 04:37:33.803980 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Refreshing trait associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, traits: COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_SOUND_MODEL_PCSPK,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 04:37:33.998431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b32bd815-386f-49ee-bd7b-360b8c3f1d63 req-6ac92eba-5c93-4e45-9eb7-93f9efc0307a service nova] Releasing lock "refresh_cache-2129e698-f081-4a1b-ab59-fe36409dfe71" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:34.077992 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:34.078238 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:34.085333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:34.581131 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:35.088290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.617s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:35.091146 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:35.094416 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:37:35.094550 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Claim successful on node np0000000747
May 14 04:37:35.150744 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Deleted allocations for instance ea107286-2cae-47ed-a3ee-a3ad8bf15ae8
May 14 04:37:35.994152 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:36.160484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-385b46d4-2e73-4d97-88c0-b859a7581db7 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "ea107286-2cae-47ed-a3ee-a3ad8bf15ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.550s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:36.245487 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:36.351294 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:36.351482 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:36.854771 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:37.363549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:37.363549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:37:37.869440 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:37:37.869694 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:37:37.870625 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:37.870944 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:37.970724 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cb12faaf3d144c3a097833825ae04dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f729528c329420ba9589c48372a9bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:37:38.373529 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:37:38.401755 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Successfully created port: 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:37:38.876408 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:37:38.928986 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Successfully updated port: 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:37:38.991663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:38.991663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:39.004027 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-changed-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:39.004541 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing instance network info cache due to event network-changed-23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:39.004703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:39.004828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:39.005297 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing network info cache for port 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:39.380269 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Booting with volume 36b77954-d0e8-47a7-b958-4047c5e9d12f at /dev/vda
May 14 04:37:39.419385 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:39.431642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:39.432426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:37:39.453285 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:39.496436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:37:39.502649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:37:39.502808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:37:39.507412 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:39.513061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:37:39.515413 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe85:848a', 'fe80::889a:97ff:feb9:f2c', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:feac:93f9', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:37:39.515413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:37:39.515849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:37:39.516766 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:39.517267 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating existing volume attachment record: 916e4128-53b9-4cc6-8d94-a6f7ed425d25 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:37:39.588596 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:39.726970 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:40.059388 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:40.059388 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:40.069389 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:37:40.069389 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Claim successful on node np0000000747
May 14 04:37:40.230326 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-64eff599-1b99-4bbf-aa33-394ddbc0c57a req-1cab4240-183e-45ea-b6b9-aa61d6e0561e service nova] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:40.231224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:40.232212 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:37:40.791356 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:40.946453 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:40.995996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:41.073193 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:41.245708 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:41.346716 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:41.346959 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:41.574948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:41.575609 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance network_info: |[{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:37:41.604308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:37:41.605637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:37:41.606228 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Creating image(s)
May 14 04:37:41.607268 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:37:41.607465 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Ensure instance console log exists: /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:37:41.607849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:41.608319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:41.608319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:41.608747 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Start _get_guest_xml network_info=[{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '916e4128-53b9-4cc6-8d94-a6f7ed425d25', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '87bad06f-f93f-449d-b7f3-adeb4a1767ee', 'attached_at': '', 'detached_at': '', 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'serial': '36b77954-d0e8-47a7-b958-4047c5e9d12f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:37:41.612328 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:41.613863 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-424521620', uuid='87bad06f-f93f-449d-b7f3-adeb4a1767ee'), owner=OwnerMeta(userid='4cb12faaf3d144c3a097833825ae04dc', username='tempest-TestInstancesWithCinderVolumes-1242058295-project-member', projectid='7f729528c329420ba9589c48372a9bf0', projectname='tempest-TestInstancesWithCinderVolumes-1242058295'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733461.6131482) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:37:41.615430 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:37:41.615791 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:37:41.616829 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:37:41.617028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:37:41.617987 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:37:41.618427 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:37:41.618427 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:37:41.618633 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:37:41.618633 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:37:41.618761 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:37:41.618821 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:37:41.619248 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:37:41.619248 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:37:41.619248 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:37:41.619515 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:37:41.619515 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:37:41.631526 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:37:41.632023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:41.632253 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:41.632558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:41.632845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:37:41.647006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:41.648225 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:41.648688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:41.648983 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:41.649284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:41.649479 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:41.665929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:41.665929 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:41.667079 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:41.667079 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:41.681432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f] added
May 14 04:37:41.681432 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:41.681432 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:41.681432 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:41.681432 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:41.681432 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:41.681432 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:41.681683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:41.681726 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:41.681867 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:41.683887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f] added
May 14 04:37:41.683887 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:41.683887 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:41.683887 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:41.683887 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:41.683887 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:41.683887 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:41.684093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:41.684262 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:41.684382 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:41.849433 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:42.355563 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.297s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:42.356000 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:37:42.682228 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:42.684723 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:42.694425 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:42.694425 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:42.699426 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:42.699426 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.705938 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.713939 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.721075 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.721075 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.721075 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.721075 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.721075 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:42.721364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.721364 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.721364 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.721364 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.721364 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:42.728454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.728454 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.728454 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.728454 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.728454 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:42.728596 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.728596 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.728596 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.728596 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.728596 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:42.757608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.50.100,3260]
May 14 04:37:42.757608 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.50.100,3260] successful.
May 14 04:37:42.757608 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.769042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.775909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.40.100,3260]
May 14 04:37:42.775909 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.40.100,3260] successful.
May 14 04:37:42.775909 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.786388 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.786744 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:42.786744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:42.787047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:42.787769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('11', '-', '-', 0) found on session 138 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:42.787879 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:42.789076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:42.802069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 138 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:42.802069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.809158 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:42.809325 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:42.809512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:42.809629 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:42.810284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('12', '-', '-', 0) found on session 139 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:42.810406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:42.829198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 139 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:42.829401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:42.861042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:37:42.861340 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:37:42.861402 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:42.861822 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:42.947956 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a74e809c82bf46ce93759af89887f6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c56a1dd0473425da8eddafc3d4c27a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:37:43.365345 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:37:43.424740 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Successfully created port: 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:37:43.649438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:37:43.871131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:37:43.906628 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Successfully updated port: 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:37:43.954548 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-changed-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:43.955872 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Refreshing instance network info cache due to event network-changed-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:43.955872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] Acquiring lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:43.955872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] Acquired lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:43.955872 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Refreshing network info cache for port 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:44.408713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:44.457859 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:44.524371 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:44.656766 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:44.671162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found WWN 3300000002512bc16 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:37:44.671429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:44.671582 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000002512bc16', 'path': '/dev/dm-6', 'multipath_id': '3300000002512bc16'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:44.671723 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002512bc16', 'path': '/dev/dm-6', 'multipath_id': '3300000002512bc16'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:37:44.878157 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:37:44.879058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:37:44.879292 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Creating image(s)
May 14 04:37:44.879763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:44.879927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:44.880336 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:44.880943 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:37:44.883361 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:37:44.884382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:44.974939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:44.976590 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:44.977464 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:44.977792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:44.979553 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:44.981820 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:37:44.987130 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:37:44.987519 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:45.070459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:45.070945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:45.124637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk 1073741824" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:45.125107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:45.125465 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:45.159999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fbd835de-8311-4091-8625-748c57ee497e req-154e115d-d983-4987-92dc-d7c4ebe76bd2 service nova] Releasing lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:45.160716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquired lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:45.161045 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:37:45.178327 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-424521620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testinstanceswithcindervolumes-server-424521620',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDgb8s1wbKy6IoR+2kyeaolv32X7/uukwGy0VIh3nMwhnOGR6mrXxoO0kwOuyzEsWyiRu1E8/BAtUWH6sX7RgI5gfErpCQ9mtKwSfkJ6mo+0kLEw1QFUxBofhSTsIQk8Q==',key_name='tempest-TestInstancesWithCinderVolumes-404292981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f729528c329420ba9589c48372a9bf0',ramdisk_id='',reservation_id='r-nfy1ro0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1242058295',owner_user_name='tempest-TestInstancesWithCinderVolumes-1242058295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:39Z,user_data=None,user_id='4cb12faaf3d144c3a097833825ae04dc',uuid=87bad06f-f93f-449d-b7f3-adeb4a1767ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:37:45.178651 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converting VIF {"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:45.179555 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:45.180606 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'pci_devices' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:45.216093 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:45.216502 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:37:45.216768 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:45.302541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:45.302997 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Cannot resize image /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:37:45.303381 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:37:45.303553 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Ensure instance console log exists: /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:37:45.303833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:45.304097 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:45.304210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:45.488543 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:45.684059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] End _get_guest_xml xml=<domain type="qemu">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <uuid>87bad06f-f93f-449d-b7f3-adeb4a1767ee</uuid>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <name>instance-0000003b</name>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-424521620</nova:name>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:37:41</nova:creationTime>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:user uuid="4cb12faaf3d144c3a097833825ae04dc">tempest-TestInstancesWithCinderVolumes-1242058295-project-member</nova:user>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:project uuid="7f729528c329420ba9589c48372a9bf0">tempest-TestInstancesWithCinderVolumes-1242058295</nova:project>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         <nova:port uuid="23b94dab-67f7-492f-a363-92579411b25c">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <system>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="serial">87bad06f-f93f-449d-b7f3-adeb4a1767ee</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="uuid">87bad06f-f93f-449d-b7f3-adeb4a1767ee</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </system>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <os>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </os>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <features>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </features>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   <devices>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/disk.config"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <alias name="ua-36b77954-d0e8-47a7-b958-4047c5e9d12f"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-6"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <serial>36b77954-d0e8-47a7-b958-4047c5e9d12f</serial>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:95:d5:73"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <target dev="tap23b94dab-67"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </interface>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/console.log" append="off"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </serial>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <video>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </video>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </rng>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:   </devices>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]: </domain>
May 14 04:37:45.684059 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Preparing to wait for external event network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-424521620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testinstanceswithcindervolumes-server-424521620',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDgb8s1wbKy6IoR+2kyeaolv32X7/uukwGy0VIh3nMwhnOGR6mrXxoO0kwOuyzEsWyiRu1E8/BAtUWH6sX7RgI5gfErpCQ9mtKwSfkJ6mo+0kLEw1QFUxBofhSTsIQk8Q==',key_name='tempest-TestInstancesWithCinderVolumes-404292981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f729528c329420ba9589c48372a9bf0',ramdisk_id='',reservation_id='r-nfy1ro0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1242058295',owner_user_name='tempest-TestInstancesWithCinderVolumes-1242058295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:39Z,user_data=None,user_id='4cb12faaf3d144c3a097833825ae04dc',uuid=87bad06f-f93f-449d-b7f3-adeb4a1767ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:37:45.685708 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converting VIF {"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:45.686630 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:45.686630 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:37:45.686828 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.687093 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:45.687392 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:37:45.688025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.688165 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac0bb37c-8ed5-57ec-9b31-7a18e65e7ee9', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:45.689161 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.689984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:45.693007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.694783 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.694923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23b94dab-67, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:45.695895 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23b94dab-67, col_values=(('qos', UUID('b9900276-d860-4a82-b2ef-ea52adc1fd4a')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:45.696057 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23b94dab-67, col_values=(('external_ids', {'iface-id': '23b94dab-67f7-492f-a363-92579411b25c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:d5:73', 'vm-uuid': '87bad06f-f93f-449d-b7f3-adeb4a1767ee'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:45.699428 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:45.702184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:45.702993 np0000000747 nova-compute[97971]: INFO os_vif [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67')
May 14 04:37:45.725919 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:37:45.853060 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:45.965318 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating instance_info_cache with network_info: [{"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:46.244631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:46.467183 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Releasing lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:46.467465 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance network_info: |[{"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:37:46.469314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Start _get_guest_xml network_info=[{"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:37:46.473426 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:37:46.474644 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-63291331', uuid='e0dfd328-2cf0-4e24-b9b2-6860817d4537'), owner=OwnerMeta(userid='a74e809c82bf46ce93759af89887f6b7', username='tempest-AttachVolumeTestJSON-948226058-project-member', projectid='7c56a1dd0473425da8eddafc3d4c27a7', projectname='tempest-AttachVolumeTestJSON-948226058'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733466.4743092) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:37:46.475774 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:37:46.476179 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:37:46.477023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:37:46.477217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:37:46.478138 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:37:46.478516 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:37:46.478759 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:37:46.478949 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:37:46.479129 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:37:46.479279 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:37:46.479466 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:37:46.479625 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:37:46.479762 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:37:46.479925 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:37:46.480098 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:37:46.480273 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:37:46.491429 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-63291331',display_name='tempest-AttachVolumeTestJSON-server-63291331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-63291331',id=60,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzOyS1Wo2Z9cLhJlEPFSevz/Do34U7YCgdj8urCP7AtPvTkFoOK7ctJnQGdCdfANHwykCmBjFkiq/NOrxyjfKbpsYJKqx67ij5Eu7A1gLo3QNQdbWq1FO8D+E9Y8zmtAg==',key_name='tempest-keypair-1510604320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-kn9zup00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=e0dfd328-2cf0-4e24-b9b2-6860817d4537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:37:46.491696 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:46.492279 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:46.492807 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'pci_devices' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:46.494760 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:46.995058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] End _get_guest_xml xml=<domain type="qemu">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <uuid>e0dfd328-2cf0-4e24-b9b2-6860817d4537</uuid>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <name>instance-0000003c</name>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:name>tempest-AttachVolumeTestJSON-server-63291331</nova:name>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:37:46</nova:creationTime>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:user uuid="a74e809c82bf46ce93759af89887f6b7">tempest-AttachVolumeTestJSON-948226058-project-member</nova:user>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:project uuid="7c56a1dd0473425da8eddafc3d4c27a7">tempest-AttachVolumeTestJSON-948226058</nova:project>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         <nova:port uuid="0ecbd71b-c99c-4a79-ac7a-2c1215782bd6">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <system>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="serial">e0dfd328-2cf0-4e24-b9b2-6860817d4537</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="uuid">e0dfd328-2cf0-4e24-b9b2-6860817d4537</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </system>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <os>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </os>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <features>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </features>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   <devices>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.config"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </disk>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:75:da:32"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <target dev="tap0ecbd71b-c9"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </interface>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/console.log" append="off"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </serial>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <video>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </video>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </rng>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:   </devices>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]: </domain>
May 14 04:37:46.995058 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Preparing to wait for external event network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-63291331',display_name='tempest-AttachVolumeTestJSON-server-63291331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-63291331',id=60,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzOyS1Wo2Z9cLhJlEPFSevz/Do34U7YCgdj8urCP7AtPvTkFoOK7ctJnQGdCdfANHwykCmBjFkiq/NOrxyjfKbpsYJKqx67ij5Eu7A1gLo3QNQdbWq1FO8D+E9Y8zmtAg==',key_name='tempest-keypair-1510604320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-kn9zup00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=e0dfd328-2cf0-4e24-b9b2-6860817d4537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:46.997158 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:46.997426 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:37:46.997544 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:46.997763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:46.997980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:37:46.998422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:46.998543 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31e606a2-a750-54ad-b6e5-a529912b25d9', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:46.999556 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:47.000225 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:47.005141 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:47.006788 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:47.006926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ecbd71b-c9, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:47.007165 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ecbd71b-c9, col_values=(('qos', UUID('e4b2ff74-e1c1-4bb9-a3d4-d4a9c9e79b91')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:47.007292 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ecbd71b-c9, col_values=(('external_ids', {'iface-id': '0ecbd71b-c99c-4a79-ac7a-2c1215782bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:da:32', 'vm-uuid': 'e0dfd328-2cf0-4e24-b9b2-6860817d4537'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:47.008089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:47.009139 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:47.017171 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:47.018263 np0000000747 nova-compute[97971]: INFO os_vif [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9')
May 14 04:37:47.150454 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00038547399981325725 future=<Future at 0x7435f8565760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:47.150600 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:47.151642 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733452.1498396, ea107286-2cae-47ed-a3ee-a3ad8bf15ae8 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:47.151642 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] VM Stopped (Lifecycle Event)
May 14 04:37:47.218462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:47.218462 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:47.218692 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No VIF found with MAC fa:16:3e:95:d5:73, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:47.218940 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Using config drive
May 14 04:37:47.596456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:47.596456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:47.596456 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Attaching volume a8fb3607-f55e-4078-9cec-433abc422753 to /dev/vdb
May 14 04:37:47.633969 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:47.644401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:37:47.653361 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21c50217-6bfb-4b11-84ee-405872213456 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: ea107286-2cae-47ed-a3ee-a3ad8bf15ae8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:47.665547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:47.709649 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:37:47.709839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:37:47.717694 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:37:47.718828 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe85:848a', 'fe80::889a:97ff:feb9:f2c', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:feac:93f9', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:37:47.718975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:37:47.719063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:37:47.719327 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:47.719713 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating existing volume attachment record: 1d9ba555-8937-4acc-a255-03a44a5d70bd {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:37:47.726172 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:47.837366 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Creating config drive at /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/disk.config
May 14 04:37:47.840804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkj2wyqgm {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:47.894268 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkj2wyqgm" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:48.258389 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.289476 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.292386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.304718 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f6476b7f-acf4-4195-84a2-dfa8058b03a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'serial': 'a8fb3607-f55e-4078-9cec-433abc422753'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:37:48.307649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:37:48.308077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:48.308232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:48.308722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:48.308913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:37:48.322660 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:48.323321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:48.324216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:48.324465 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:48.324924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:48.325153 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:48.336870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:48.336870 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:48.341764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:37:48.341764 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753] added
May 14 04:37:48.349634 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:48.349634 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:48.349634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:48.350057 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:48.350057 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:48.357029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753] added
May 14 04:37:48.357029 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:37:48.357029 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:48.357029 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:48.357029 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:37:48.357029 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:37:48.357029 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:48.357294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:37:48.357444 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:37:48.357637 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:37:48.369548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.428198 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61c8e021-7a92-4d18-83e5-bcd6ab5e795c req-e1a76a08-9259-4a95-a2bd-2c6c8a33ec25 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:48.428512 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61c8e021-7a92-4d18-83e5-bcd6ab5e795c req-e1a76a08-9259-4a95-a2bd-2c6c8a33ec25 service nova] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:48.428801 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61c8e021-7a92-4d18-83e5-bcd6ab5e795c req-e1a76a08-9259-4a95-a2bd-2c6c8a33ec25 service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:48.428901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-61c8e021-7a92-4d18-83e5-bcd6ab5e795c req-e1a76a08-9259-4a95-a2bd-2c6c8a33ec25 service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:48.429069 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-61c8e021-7a92-4d18-83e5-bcd6ab5e795c req-e1a76a08-9259-4a95-a2bd-2c6c8a33ec25 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Processing event network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:37:48.517928 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.536352 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:48.536507 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:48.537456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:75:da:32, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:48.537456 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Using config drive
May 14 04:37:48.581725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.587886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.589876 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.614604 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:48.964531 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733468.964104, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:48.965162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:37:48.965487 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] VM Started (Lifecycle Event)
May 14 04:37:48.967851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:37:48.970076 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance spawned successfully.
May 14 04:37:48.970460 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:37:49.042151 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:49.175965 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Creating config drive at /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.config
May 14 04:37:49.180457 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf0xg41i2 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:37:49.248419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf0xg41i2" returned: 0 in 0.068s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:37:49.350571 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:37:49.358253 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:49.364142 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:49.364142 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:37:49.371431 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:37:49.371431 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.378755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.386472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.395446 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.395828 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.405097 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.405466 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:49.440977 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.40.100,3260]
May 14 04:37:49.440977 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.40.100,3260] successful.
May 14 04:37:49.440977 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.452425 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.457720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.50.100,3260]
May 14 04:37:49.457720 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.50.100,3260] successful.
May 14 04:37:49.457720 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.468715 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:49.469715 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.470278 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.470513 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:49.470996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:49.471235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:49.477493 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:49.479731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('13', '-', '-', 0) found on session 140 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:49.480214 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:49.484389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.484389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.484389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.484389 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.484634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.484759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.491257 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:49.491563 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:49.493194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:49.496753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:37:49.497228 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 140 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:49.497421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:49.499445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('14', '-', '-', 0) found on session 141 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:37:49.499577 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:37:49.516977 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 141 and hctl ['14', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:49.754348 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:49.788997 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:49.880809 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:49.975829 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7ce6b6d3-7a1e-45f8-add8-b4499931104b req-4604c22b-cfa4-4023-8d3a-89b643714da6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:49.975829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7ce6b6d3-7a1e-45f8-add8-b4499931104b req-4604c22b-cfa4-4023-8d3a-89b643714da6 service nova] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:49.976031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7ce6b6d3-7a1e-45f8-add8-b4499931104b req-4604c22b-cfa4-4023-8d3a-89b643714da6 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:49.976168 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7ce6b6d3-7a1e-45f8-add8-b4499931104b req-4604c22b-cfa4-4023-8d3a-89b643714da6 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:49.976538 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7ce6b6d3-7a1e-45f8-add8-b4499931104b req-4604c22b-cfa4-4023-8d3a-89b643714da6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Processing event network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:37:49.981440 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:37:49.981957 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733469.981565, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:49.981957 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] VM Paused (Lifecycle Event)
May 14 04:37:49.998414 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Took 8.39 seconds to spawn the instance on the hypervisor.
May 14 04:37:49.998593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:50.115995 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:50.118388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:50.129659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:50.130534 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:50.151529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:50.296270 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:50.298176 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing instance network info cache due to event network-changed-85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:50.298434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] Acquiring lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:50.298581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] Acquired lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:50.298974 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Refreshing network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:50.491078 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:50.493471 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733470.49325, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:50.493678 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] VM Resumed (Lifecycle Event)
May 14 04:37:50.507218 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:50.507293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:50.507584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:50.507729 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:50.510980 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] No waiting events found dispatching network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:50.511151 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ffd48f7b-6391-4ed5-b180-7a3906745444 req-1cc65b5d-1080-4085-bf6d-e79fdcec245f service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received unexpected event network-vif-plugged-23b94dab-67f7-492f-a363-92579411b25c for instance with vm_state active and task_state None.
May 14 04:37:50.514665 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Took 16.49 seconds to build instance.
May 14 04:37:50.517530 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 141 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:37:50.517697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:37:50.567873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:37:50.572102 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:37:50.574301 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance spawned successfully.
May 14 04:37:50.574625 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:37:50.803077 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:50.829526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:50.829526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:50.829782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:50.829828 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:50.829962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:50.832203 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Terminating instance
May 14 04:37:50.996966 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:50.998746 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:51.016603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.994s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:51.079661 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.079784 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.080782 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.080782 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.080782 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.080782 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:37:51.088631 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:51.231139 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updated VIF entry in instance network info cache for port 85da9544-f46c-4f84-add3-d8638cee4eee. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:51.231497 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [{"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:51.245707 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.335562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:37:51.353531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found WWN 3300000004ce0252b for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:37:51.353531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:51.361075 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000004ce0252b', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000004ce0252b'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:51.361075 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.361075 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004ce0252b', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000004ce0252b'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:37:51.361696 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.365921 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:37:51.365921 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:37:51.365921 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:37:51.368018 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x74361824a840>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': 'f6476b7f-acf4-4195-84a2-dfa8058b03a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'serial': 'a8fb3607-f55e-4078-9cec-433abc422753'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:37:51.368779 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.cryptsetup [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 14 04:37:51.369037 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97971) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 04:37:51.369164 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.cryptsetup [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] opening encrypted volume /dev/dm-9 {{(pid=97971) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 14 04:37:51.383667 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.384738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.414507 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.475643 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:51.500934 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733471.5006096, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:51.501245 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] VM Started (Lifecycle Event)
May 14 04:37:51.585206 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Took 6.71 seconds to spawn the instance on the hypervisor.
May 14 04:37:51.585464 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:51.660233 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.667108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:51.683334 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Instance destroyed successfully.
May 14 04:37:51.685644 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lazy-loading 'resources' on Instance uuid 9078c4c9-d972-44b1-843b-2320db6ee10a {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:51.733831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f8c97a94-1681-4465-9a90-95f92ea307d6 req-4f703438-7c75-47f8-8623-e7f0c7804c0b service nova] Releasing lock "refresh_cache-9078c4c9-d972-44b1-843b-2320db6ee10a" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:51.981043 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Attempting to attach volume a8fb3607-f55e-4078-9cec-433abc422753 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:37:51.984992 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:   <alias name="ua-a8fb3607-f55e-4078-9cec-433abc422753"/>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:   <serial>a8fb3607-f55e-4078-9cec-433abc422753</serial>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]: </disk>
May 14 04:37:51.984992 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:37:52.003436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:52.009807 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.015234 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:52.065832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:52.067212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:52.067450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:52.067583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:52.067755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] No waiting events found dispatching network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:52.068078 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received unexpected event network-vif-plugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 for instance with vm_state active and task_state None.
May 14 04:37:52.068861 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:52.069024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:52.069547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:52.069547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:52.069547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:52.069547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:52.070038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:52.070038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Acquiring lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:52.070038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:52.070038 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:52.070178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] No waiting events found dispatching network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:52.070308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-65edd388-8154-41a5-a042-b4ee460cb4f8 req-cacaee9a-a40e-4acc-8f47-b104b8ff29d7 service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-unplugged-85da9544-f46c-4f84-add3-d8638cee4eee for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:52.099644 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Took 12.09 seconds to build instance.
May 14 04:37:52.186483 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-14T04:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2058248421',display_name='tempest-TestShelveInstance-server-2058248421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testshelveinstance-server-2058248421',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOymCQWd3Z+7vZw4v/tetdIhFfgL9teebsgfE4tojPxbHFzyJ0esR0KSkptKmGwHM0Rg1VyaCD6nLE+KXDdifjEf7QN5fRih0Y1KsH1JmoRetDNk9mrUEKVYIELVs/sbCg==',key_name='tempest-TestShelveInstance-1575134270',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:37:12Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='582a6b9df4fc4204ba57f289f810d031',ramdisk_id='',reservation_id='r-lg0s8idr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-710703435',owner_user_name='tempest-TestShelveInstance-710703435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:37:12Z,user_data=None,user_id='bdf7a94492f3476fb201e51478145d07',uuid=9078c4c9-d972-44b1-843b-2320db6ee10a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:37:52.186936 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converting VIF {"id": "85da9544-f46c-4f84-add3-d8638cee4eee", "address": "fa:16:3e:85:84:8a", "network": {"id": "2c8277c0-cdbb-48ec-9b3b-4526716bcde0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700911174-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "582a6b9df4fc4204ba57f289f810d031", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85da9544-f4", "ovs_interfaceid": "85da9544-f46c-4f84-add3-d8638cee4eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:37:52.187563 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:37:52.187982 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:37:52.192015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.192015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85da9544-f4, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:52.192534 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.193781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:52.195825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.196187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6a84891-2ab3-47a4-8755-f5af52613293) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:37:52.196875 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.197689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:37:52.198513 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:52.199922 np0000000747 nova-compute[97971]: INFO os_vif [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:8a,bridge_name='br-int',has_traffic_filtering=True,id=85da9544-f46c-4f84-add3-d8638cee4eee,network=Network(2c8277c0-cdbb-48ec-9b3b-4526716bcde0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85da9544-f4')
May 14 04:37:52.201413 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:37:52.201695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:52.201901 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:52.202278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:52.202547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:37:52.202703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:52.231255 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsi session list stdout=tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:52.231782 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '141')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:37:52.231782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '133')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:52.232687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475', '132')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:52.233493 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8494a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:37:52.233706 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:37:52.233945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Flush multipath device 3300000002a9f2042 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:37:52.289480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:52.332173 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:52.371364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:37:52.371602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:37:52.372808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:37:52.383439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:37:52.383704 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:37:52.396331 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.436728 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260]
May 14 04:37:52.436728 np0000000747 nova-compute[97971]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.40.100,3260] successful.
May 14 04:37:52.436728 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.456046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.469544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.503854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260]
May 14 04:37:52.503854 np0000000747 nova-compute[97971]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475, portal: 192.168.50.100,3260] successful.
May 14 04:37:52.503854 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.520859 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733472.5193686, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:52.520859 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] VM Paused (Lifecycle Event)
May 14 04:37:52.523638 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:52.526228 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:52.526228 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] <== disconnect_volume: return (322ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:52.526228 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:37:52.526228 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deleting instance files /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a_del
May 14 04:37:52.526228 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deletion of /opt/stack/data/nova/instances/9078c4c9-d972-44b1-843b-2320db6ee10a_del complete
May 14 04:37:52.601022 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5b6a8efb-c6d5-4bf9-9caf-ffbd9f5fc29c tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.610s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:52.680727 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-changed-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:52.681035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing instance network info cache due to event network-changed-23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:52.681251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:52.681417 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:52.682975 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing network info cache for port 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:53.024042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:53.026494 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733473.0260494, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:37:53.026785 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] VM Resumed (Lifecycle Event)
May 14 04:37:53.033936 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Took 1.70 seconds to destroy the instance on the hypervisor.
May 14 04:37:53.034689 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:37:53.034989 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:37:53.035113 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:37:53.035699 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:53.131894 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:53.189997 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:53.529310 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:37:53.531932 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:37:53.647223 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:53.652630 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:53.652835 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:53.653002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:37:53.653169 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:ac:93:f9, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:37:53.776411 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updated VIF entry in instance network info cache for port 23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:53.776961 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:53.930004 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:54.034779 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999659758000234 future=<Future at 0x7436183dd460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:54.035213 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999195065000094 future=<Future at 0x7436183dd460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:54.035351 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999023217000286 future=<Future at 0x7436183dd460 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:54.128787 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d2a30ffc-7cc7-4839-a11c-6c00236f10da req-ddac6d05-6571-4e35-912a-afb12f1f851f service nova] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Received event network-vif-deleted-85da9544-f46c-4f84-add3-d8638cee4eee {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:54.279141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36f1c378-faac-41f5-9254-bb165f1b7382 req-263471d4-1cb9-49de-b36e-5aa340c1f50c service nova] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:54.432161 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Took 1.40 seconds to deallocate network for instance.
May 14 04:37:54.734069 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-changed-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:54.734471 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Refreshing instance network info cache due to event network-changed-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:54.734471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] Acquiring lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:54.734471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] Acquired lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:54.734598 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Refreshing network info cache for port 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:54.975854 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:37:54.977712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Deleting volume: 3fcbda60-c8cf-4b08-a9ac-16e6bd3f7475 {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:37:55.212090 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ce0ac086-67a8-43a3-984a-bad9d1b0f2db tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.616s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:55.237019 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:55.388924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:55.389102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:55.508863 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:55.511939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:55.512187 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:55.668752 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updated VIF entry in instance network info cache for port 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:55.669093 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating instance_info_cache with network_info: [{"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:55.817881 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:37:55.819057 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:37:55.891592 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Detaching volume a8fb3607-f55e-4078-9cec-433abc422753
May 14 04:37:55.932978 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Attempting to driver detach volume a8fb3607-f55e-4078-9cec-433abc422753 from mountpoint /dev/vdb
May 14 04:37:55.979076 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': 'f6476b7f-acf4-4195-84a2-dfa8058b03a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'serial': 'a8fb3607-f55e-4078-9cec-433abc422753'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:37:55.982808 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-a8fb3607-f55e-4078-9cec-433abc422753 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:37:55.983933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-a8fb3607-f55e-4078-9cec-433abc422753 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:37:55.984052 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Attempting to detach device vdb from instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:37:55.984245 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <alias name="ua-a8fb3607-f55e-4078-9cec-433abc422753"/>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <serial>a8fb3607-f55e-4078-9cec-433abc422753</serial>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]: </disk>
May 14 04:37:55.984245 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:37:55.989997 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 from the persistent domain config.
May 14 04:37:55.990221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] (1/8): Attempting to detach device vdb with device alias ua-a8fb3607-f55e-4078-9cec-433abc422753 from instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:37:55.990439 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <alias name="ua-a8fb3607-f55e-4078-9cec-433abc422753"/>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <serial>a8fb3607-f55e-4078-9cec-433abc422753</serial>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]: </disk>
May 14 04:37:55.990439 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:37:56.172635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7390d302-21b8-403d-8176-c9317bdc1fd8 req-d9fed220-d14d-40a2-b150-98d124444af6 service nova] Releasing lock "refresh_cache-e0dfd328-2cf0-4e24-b9b2-6860817d4537" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:56.203315 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-changed-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:56.206003 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing instance network info cache due to event network-changed-23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:37:56.206003 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:37:56.206003 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:37:56.206003 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing network info cache for port 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:37:56.248120 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:56.322485 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:37:56.513533 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733476.5130126, f6476b7f-acf4-4195-84a2-dfa8058b03a2 => ua-a8fb3607-f55e-4078-9cec-433abc422753> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:37:56.514421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a8fb3607-f55e-4078-9cec-433abc422753 for instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:37:56.532906 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 from the live domain config.
May 14 04:37:56.538742 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:37:56.538977 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:37:56.539269 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:37:56.539925 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7435f8433170>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': 'f6476b7f-acf4-4195-84a2-dfa8058b03a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'serial': 'a8fb3607-f55e-4078-9cec-433abc422753'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:37:56.540154 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.cryptsetup [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] closing encrypted volume /dev/dm-10 {{(pid=97971) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 14 04:37:56.566748 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:37:56.567054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:37:56.567245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:37:56.567554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:37:56.567867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a8fb3607-f55e-4078-9cec-433abc422753', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:37:56.567988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:56.593471 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753 (non-flash)
May 14 04:37:56.593691 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:37:56.593869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '141')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:37:56.593869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '140')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:56.594745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753', '141')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:37:56.595438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84bb2e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'): ({'sdi'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:37:56.595643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:37:56.595898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flush multipath device 3300000004ce0252b {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:37:56.641140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:56.686044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:37:56.706544 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:56.736040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:37:56.736268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:37:56.740201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:37:56.753254 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:37:56.753485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:37:56.765155 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.793447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.40.100,3260]
May 14 04:37:56.793447 np0000000747 nova-compute[97971]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.40.100,3260] successful.
May 14 04:37:56.793447 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.810382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.823980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.830179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.318s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:56.854831 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.50.100,3260]
May 14 04:37:56.854831 np0000000747 nova-compute[97971]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-a8fb3607-f55e-4078-9cec-433abc422753, portal: 192.168.50.100,3260] successful.
May 14 04:37:56.854831 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.869560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:37:56.870394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:37:56.870505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== disconnect_volume: return (302ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:37:56.870635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:37:56.903900 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Deleted allocations for instance 9078c4c9-d972-44b1-843b-2320db6ee10a
May 14 04:37:57.110836 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:37:57.197260 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:57.258960 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updated VIF entry in instance network info cache for port 23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:37:57.259330 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:37:57.419098 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:37:57.761574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77168fc5-c9bb-4882-8528-b589ab31ca30 req-56570090-1f38-45bd-b006-2c4dff62d5b5 service nova] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:37:57.913575 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-734e3b06-9e4a-4c37-9c4e-c0e65c794d7f tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Lock "9078c4c9-d972-44b1-843b-2320db6ee10a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.084s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:58.428688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b75af81-35cb-4516-96c6-b5aa343bafb3 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:58.701557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:58.701761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:58.701948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:58.702071 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:58.702241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:58.703987 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Terminating instance
May 14 04:37:59.206633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:37:59.227933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.240862 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.254778 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.260295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.285665 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.286651 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.426272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:37:59.426498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:37:59.426703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:37:59.426857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:37:59.426998 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] No waiting events found dispatching network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:37:59.427138 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1520755b-a0a5-46ed-93b0-9cabdc887a4d req-e15e9a23-5355-4a02-80a7-30911cb4c057 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:37:59.535570 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:37:59.572917 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999652976000107 future=<Future at 0x7435f823a5d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:37:59.573934 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Instance destroyed successfully.
May 14 04:37:59.577076 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'resources' on Instance uuid f6476b7f-acf4-4195-84a2-dfa8058b03a2 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:00.080210 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1451884945',display_name='tempest-TestEncryptedCinderVolumes-server-1451884945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1451884945',id=57,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI+3yy3bCyumK6Ml9UqVypyrsGrNUzGCeUN/d+HCi/Qyf5o8B5bP4+SYQNhb5GiOuVaL3WpmPsr1ANosy1B1rYsn73fEzsNmJAxFd8WJ+deZ+dTo9dc6mUK167k+euu7Q==',key_name='tempest-keypair-1807086439',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:37:06Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-beh00a9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=f6476b7f-acf4-4195-84a2-dfa8058b03a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:38:00.080384 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "address": "fa:16:3e:ac:93:f9", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09443db9-0c", "ovs_interfaceid": "09443db9-0c94-4ca9-aa5d-80bb0f290fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:00.080753 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:00.081050 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:38:00.081972 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.082236 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09443db9-0c, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:00.084187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.084187 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:00.084597 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.085327 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.085451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebcd686e-26fc-4a0b-beca-bc937d10a8ef) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:00.089330 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.089330 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:00.089330 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.092222 np0000000747 nova-compute[97971]: INFO os_vif [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:93:f9,bridge_name='br-int',has_traffic_filtering=True,id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09443db9-0c')
May 14 04:38:00.092898 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Deleting instance files /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2_del
May 14 04:38:00.093489 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Deletion of /opt/stack/data/nova/instances/f6476b7f-acf4-4195-84a2-dfa8058b03a2_del complete
May 14 04:38:00.336435 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:00.603755 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Took 1.40 seconds to destroy the instance on the hypervisor.
May 14 04:38:00.604202 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:38:00.604337 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:38:00.604406 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:38:00.604602 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:00.674725 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:01.175751 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5e30117-c4e7-4607-bb19-b8b7e72f5eac req-7b3f3a29-1f6c-41c9-b781-5027f6f8c1c5 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-deleted-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:01.176210 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-f5e30117-c4e7-4607-bb19-b8b7e72f5eac req-7b3f3a29-1f6c-41c9-b781-5027f6f8c1c5 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Neutron deleted interface 09443db9-0c94-4ca9-aa5d-80bb0f290fd4; detaching it from the instance and deleting it from the info cache
May 14 04:38:01.176298 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f5e30117-c4e7-4607-bb19-b8b7e72f5eac req-7b3f3a29-1f6c-41c9-b781-5027f6f8c1c5 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:01.255698 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:01.500893 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:01.501601 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] Acquiring lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:01.501674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:01.501835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:01.502296 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] No waiting events found dispatching network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:01.502296 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48bb7340-7f14-4b94-9c98-90b59c30ac43 req-a4202e9b-bb1c-4152-a58e-fdbdac46c5ad service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Received event network-vif-unplugged-09443db9-0c94-4ca9-aa5d-80bb0f290fd4 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:38:01.622643 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:01.682703 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f5e30117-c4e7-4607-bb19-b8b7e72f5eac req-7b3f3a29-1f6c-41c9-b781-5027f6f8c1c5 service nova] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Detach interface failed, port_id=09443db9-0c94-4ca9-aa5d-80bb0f290fd4, reason: Instance f6476b7f-acf4-4195-84a2-dfa8058b03a2 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:38:02.124964 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Took 1.52 seconds to deallocate network for instance.
May 14 04:38:02.287366 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:02.633762 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:02.634220 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:02.944740 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:38:02.944885 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:38:03.448974 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:38:03.955269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.321s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:04.002145 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deleted allocations for instance f6476b7f-acf4-4195-84a2-dfa8058b03a2
May 14 04:38:05.010474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c30a6718-1d11-4208-a8fb-6efee32fbb94 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "f6476b7f-acf4-4195-84a2-dfa8058b03a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.309s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:05.098325 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:06.291287 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:08.779415 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:09.034909 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00035822800009555067 future=<Future at 0x7436183dd460 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:09.035360 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Emitting event <LifecycleEvent: 1778733474.034297, 9078c4c9-d972-44b1-843b-2320db6ee10a => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:09.035483 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:09.035734 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] VM Stopped (Lifecycle Event)
May 14 04:38:09.036226 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.531853426999987 future=<Future at 0x7435f823a5d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:09.036341 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.53172541899994 future=<Future at 0x7435f823a5d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:09.479537 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:09.479728 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:09.539240 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 9078c4c9-d972-44b1-843b-2320db6ee10a] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:09.982115 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:38:10.102046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:10.529033 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:10.529235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:10.532021 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:38:10.532139 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Claim successful on node np0000000747
May 14 04:38:11.293024 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:11.463914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:11.804090 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:38:11.804307 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:38:12.307307 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:38:12.813184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.284s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:12.813533 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:38:13.321597 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:38:13.324828 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:38:13.324828 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:13.328382 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:13.425426 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587fcb0c08cf47d386df9d9c088cb0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e458cafac3d48e99410f3bdfd372b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:38:13.830993 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:38:13.939349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:13.939676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:14.026520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:14.037118 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Successfully created port: ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:38:14.334046 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:38:14.442814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:38:14.568504 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00033240599987038877 future=<Future at 0x7435f823a5d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:14.568504 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:14.570799 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Emitting event <LifecycleEvent: 1778733479.5680084, f6476b7f-acf4-4195-84a2-dfa8058b03a2 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:14.570799 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] VM Stopped (Lifecycle Event)
May 14 04:38:14.586626 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Successfully updated port: ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:38:14.652861 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-changed-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:14.653551 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Refreshing instance network info cache due to event network-changed-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:14.653900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] Acquiring lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:14.654076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] Acquired lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:14.654266 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Refreshing network info cache for port ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:14.868449 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:14.868658 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:14.869112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:14.869310 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:14.869540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] No waiting events found dispatching network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:14.869803 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b0813e80-a30f-48ea-9f62-66639ea174f1 req-69660694-13db-46a8-a735-afde147f7875 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received unexpected event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae for instance with vm_state building and task_state block_device_mapping.
May 14 04:38:14.985644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:14.985923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:14.988951 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:38:14.989084 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Claim successful on node np0000000747
May 14 04:38:15.073085 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: f6476b7f-acf4-4195-84a2-dfa8058b03a2] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:15.088636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:15.103492 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:15.157187 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:15.211821 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:15.346101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:38:15.347280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:38:15.347606 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Creating image(s)
May 14 04:38:15.348535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:15.348798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:15.349365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:15.350128 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:15.354603 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:15.356319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:15.358629 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:15.453671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:15.454175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:15.454817 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:15.455430 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:15.459652 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:15.460120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:15.558532 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:15.558907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:15.629341 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk 1073741824" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:15.629901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:15.630224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:15.730749 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:15.731276 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:38:15.731583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:15.837968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:15.838482 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Cannot resize image /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:38:15.839203 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:38:15.839425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Ensure instance console log exists: /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:38:15.839884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:15.840104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:15.840320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:15.878984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a57f1df0-a2af-4943-8b06-e2bf87c24b38 req-594e3582-8374-43ab-ae11-5bf8b5201fb8 service nova] Releasing lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:15.879984 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquired lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:15.880246 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:38:16.309222 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:16.335781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:38:16.336018 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:38:16.451580 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:16.598269 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:16.769077 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating instance_info_cache with network_info: [{"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:16.838847 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:38:17.270944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Releasing lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:17.271269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance network_info: |[{"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:38:17.273061 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Start _get_guest_xml network_info=[{"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:38:17.275551 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:38:17.276814 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1742298449', uuid='41d002ce-8b67-4716-ad8c-950e02e6fa43'), owner=OwnerMeta(userid='587fcb0c08cf47d386df9d9c088cb0fd', username='tempest-TestEncryptedCinderVolumes-1204475822-project-member', projectid='8e458cafac3d48e99410f3bdfd372b6e', projectname='tempest-TestEncryptedCinderVolumes-1204475822'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733497.2764578) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:38:17.280201 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:38:17.280523 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:38:17.281391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:38:17.281558 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:38:17.285185 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:38:17.300038 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1742298449',display_name='tempest-TestEncryptedCinderVolumes-server-1742298449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1742298449',id=61,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgCCBWwX23WgNFDNS8sXPutG70KTEujtbLKAtXOvNVRkKpv7eiDCQTMpqQxz6Gau5C8KtCcvjKI6wiDWu5kQ0d6shK+SXLwe6nrAV5KYIoSEBA0TUUhst5TMRbMq3pe6w==',key_name='tempest-keypair-1784658885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-yntgrgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=41d002ce-8b67-4716-ad8c-950e02e6fa43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:38:17.300207 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:17.300900 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:17.301662 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'pci_devices' on Instance uuid 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:17.350047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:17.350757 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:38:17.514058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:17.514564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:17.804505 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] End _get_guest_xml xml=<domain type="qemu">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <uuid>41d002ce-8b67-4716-ad8c-950e02e6fa43</uuid>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <name>instance-0000003d</name>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1742298449</nova:name>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:38:17</nova:creationTime>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:user uuid="587fcb0c08cf47d386df9d9c088cb0fd">tempest-TestEncryptedCinderVolumes-1204475822-project-member</nova:user>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:project uuid="8e458cafac3d48e99410f3bdfd372b6e">tempest-TestEncryptedCinderVolumes-1204475822</nova:project>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         <nova:port uuid="ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <system>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="serial">41d002ce-8b67-4716-ad8c-950e02e6fa43</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="uuid">41d002ce-8b67-4716-ad8c-950e02e6fa43</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </system>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <os>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </os>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <features>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </features>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   <devices>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.config"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:af:9e:7c"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <target dev="tapce9361e2-6f"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </interface>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/console.log" append="off"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </serial>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <video>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </video>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </rng>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:   </devices>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]: </domain>
May 14 04:38:17.804505 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Preparing to wait for external event network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1742298449',display_name='tempest-TestEncryptedCinderVolumes-server-1742298449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1742298449',id=61,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgCCBWwX23WgNFDNS8sXPutG70KTEujtbLKAtXOvNVRkKpv7eiDCQTMpqQxz6Gau5C8KtCcvjKI6wiDWu5kQ0d6shK+SXLwe6nrAV5KYIoSEBA0TUUhst5TMRbMq3pe6w==',key_name='tempest-keypair-1784658885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-yntgrgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=41d002ce-8b67-4716-ad8c-950e02e6fa43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:38:17.806709 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:17.806990 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:17.807157 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:38:17.807471 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.807724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:17.807955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:38:17.808683 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.808834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cabac45-29c5-5a8a-9e67-7ba6923c0721', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:17.821373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.821373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:17.821373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.822968 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.823130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce9361e2-6f, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:17.823441 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce9361e2-6f, col_values=(('qos', UUID('a1f0952c-55d3-4eff-8a16-989b7ce50089')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:17.823642 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce9361e2-6f, col_values=(('external_ids', {'iface-id': 'ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:9e:7c', 'vm-uuid': '41d002ce-8b67-4716-ad8c-950e02e6fa43'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:17.824311 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.825536 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:17.830282 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:17.831045 np0000000747 nova-compute[97971]: INFO os_vif [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f')
May 14 04:38:17.857517 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:38:17.860539 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:38:17.860748 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:38:17.860994 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:17.861212 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:17.951105 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:38:18.020255 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:18.364683 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:38:18.417009 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Successfully created port: cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:38:18.867881 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Successfully updated port: cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:38:18.870863 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Booting with volume snapshot 2dced1ba-9b22-412d-b569-6d084c43b4c2 at /dev/vda
May 14 04:38:18.937427 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-changed-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:18.937427 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Refreshing instance network info cache due to event network-changed-cdf3f9ae-9f2a-422b-ac00-c75985111df3. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:18.937427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] Acquiring lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:18.937427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] Acquired lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:18.937427 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Refreshing network info cache for port cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:19.025438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:19.112380 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:19.113144 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:19.350639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:19.350639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:19.350639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:af:9e:7c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:19.350639 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Using config drive
May 14 04:38:19.369923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:19.438513 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:19.504573 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:19.609902 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:19.610214 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:19.623549 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:19.853634 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:19.961541 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Creating config drive at /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.config
May 14 04:38:19.966466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2u9y3o8c {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:20.017425 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2u9y3o8c" returned: 0 in 0.051s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:20.087010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:20.087216 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:20.087449 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attaching volume c522dcda-f796-4983-b934-3977a6951288 to /dev/vdb
May 14 04:38:20.126271 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-076a0c76-ad18-4de2-9889-9fcaa55b103e req-b6be28c1-a5b0-4669-9034-8a636a6d03b8 service nova] Releasing lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:20.129260 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:20.129260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:20.129260 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:38:20.142231 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:20.166709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:20.207792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:20.208287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:20.217998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:20.219002 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe95:d573', 'fe80::a46e:cfff:fee0:8f7d', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181'] 
May 14 04:38:20.219119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:20.219218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:20.219422 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:20.219684 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating existing volume attachment record: 65ca2b24-2f29-4824-8068-6cd0d354ecd0 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:20.468669 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.493857 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.574952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.603636 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:20.603636 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:20.669872 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-687ee1bb-ac0c-44ec-8158-d20a56fa7276 req-1630c064-dd38-4638-876b-2bc6c7794054 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:20.670131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-687ee1bb-ac0c-44ec-8158-d20a56fa7276 req-1630c064-dd38-4638-876b-2bc6c7794054 service nova] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:20.670386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-687ee1bb-ac0c-44ec-8158-d20a56fa7276 req-1630c064-dd38-4638-876b-2bc6c7794054 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:20.670533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-687ee1bb-ac0c-44ec-8158-d20a56fa7276 req-1630c064-dd38-4638-876b-2bc6c7794054 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:20.670704 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-687ee1bb-ac0c-44ec-8158-d20a56fa7276 req-1630c064-dd38-4638-876b-2bc6c7794054 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Processing event network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:38:20.717579 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:20.783005 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:20.783471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:20.783685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:20.784157 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:20.784543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:20.797229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:20.798600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:20.798600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:20.798600 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:20.798987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:20.799142 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:20.810838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:20.810838 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:20.822124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:20.822124 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:20.826006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288] added
May 14 04:38:20.826006 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:20.826006 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:20.826006 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:20.826006 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:20.826006 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:20.826006 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:20.826293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:20.826650 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:20.826786 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:20.829827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.831571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288] added
May 14 04:38:20.831571 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:20.831571 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:20.831571 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:20.831571 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:20.831571 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:20.831571 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:20.831872 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:20.832015 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:20.832216 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:20.833709 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.862050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:20.916897 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:21.060282 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating instance_info_cache with network_info: [{"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:21.270415 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733501.2700458, 41d002ce-8b67-4716-ad8c-950e02e6fa43 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:21.270593 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] VM Started (Lifecycle Event)
May 14 04:38:21.272736 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:38:21.276995 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:38:21.280337 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance spawned successfully.
May 14 04:38:21.281099 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:38:21.310418 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:21.562491 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:21.562774 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance network_info: |[{"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:38:21.773824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:21.779841 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:21.789947 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.790160 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.790461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.792543 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.792543 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.792543 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:21.827845 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:21.832928 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:21.842957 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:21.842957 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:21.854475 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:21.854475 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.862194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.868540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.881088 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.881280 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.888277 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.888420 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:21.925631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.50.100,3260]
May 14 04:38:21.925631 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.50.100,3260] successful.
May 14 04:38:21.925631 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.927298 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.40.100,3260]
May 14 04:38:21.927298 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.40.100,3260] successful.
May 14 04:38:21.927298 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.939081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.943160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.955059 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.955373 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:21.955534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:21.955534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:21.956414 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('13', '-', '-', 0) found on session 144 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:21.956545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.958074 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:21.958239 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:21.958404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:21.958543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:21.959436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('14', '-', '-', 0) found on session 145 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:21.959544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:21.973897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 144 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:21.973897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:21.978646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 145 and hctl ['14', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:22.282627 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:38:22.283141 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733502.2829401, 41d002ce-8b67-4716-ad8c-950e02e6fa43 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:22.283250 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] VM Paused (Lifecycle Event)
May 14 04:38:22.299633 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Took 6.95 seconds to spawn the instance on the hypervisor.
May 14 04:38:22.300265 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:22.329951 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:22.341995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:22.364985 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:22.412321 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:22.412684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:22.422948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:22.424017 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe95:d573', 'fe80::a46e:cfff:fee0:8f7d', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feaf:9e7c', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:38:22.424126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:22.424484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:22.424771 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:22.425216 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating existing volume attachment record: 413eee6c-e412-4735-9ca0-f3f1f2ffbece {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:22.611244 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:22.732115 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:22.732603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:22.732915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:22.733084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:22.733213 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] No waiting events found dispatching network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:22.733347 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8f97390a-ed04-40a2-a92f-a30f41e817e0 req-66e3c9ac-6760-4ce4-a694-adebaa719475 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received unexpected event network-vif-plugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae for instance with vm_state active and task_state None.
May 14 04:38:22.785842 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:22.790060 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733502.7898157, 41d002ce-8b67-4716-ad8c-950e02e6fa43 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:22.790260 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] VM Resumed (Lifecycle Event)
May 14 04:38:22.816726 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Took 12.33 seconds to build instance.
May 14 04:38:22.826937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:22.979863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 145 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:22.979863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:23.121101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:23.121323 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:23.121483 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:23.121658 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:38:23.293137 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:23.298851 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:23.318207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a3855d7e-e860-4815-b27e-df173d86d3b2 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.838s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:23.816142 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found WWN 3300000003107ff6c for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:38:23.816499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:23.816687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000003107ff6c', 'path': '/dev/dm-1', 'multipath_id': '3300000003107ff6c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:23.816823 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003107ff6c', 'path': '/dev/dm-1', 'multipath_id': '3300000003107ff6c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:38:23.819481 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:23.846224 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-changed-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:23.846398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Refreshing instance network info cache due to event network-changed-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:23.846562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] Acquiring lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:23.846750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] Acquired lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:23.846821 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Refreshing network info cache for port ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:24.164334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:24.254542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:24.255074 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:24.326721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attempting to attach volume c522dcda-f796-4983-b934-3977a6951288 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:38:24.332542 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:   <alias name="ua-c522dcda-f796-4983-b934-3977a6951288"/>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:   <serial>c522dcda-f796-4983-b934-3977a6951288</serial>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:24.332542 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:38:24.345855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:24.348609 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:24.352672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:24.443342 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:24.444016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:24.524631 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:38:24.526136 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:38:24.526422 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Creating image(s)
May 14 04:38:24.526865 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:38:24.527050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Ensure instance console log exists: /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:38:24.527333 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:24.527588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:24.527797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:24.528426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Start _get_guest_xml network_info=[{"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-14T04:38:10Z,direct_url=<?>,disk_format='raw',id=efef8077-da78-4d89-8170-c5e1b226550c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1723630228',owner='21106f072baf4c4e8fcdb07b6c3a766a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-14T04:38:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '413eee6c-e412-4735-9ca0-f3f1f2ffbece', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '194ac0aa-d0dc-44cd-90b9-3e940f75fa15', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'serial': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:38:24.535806 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:38:24.537114 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026', uuid='194ac0aa-d0dc-44cd-90b9-3e940f75fa15'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='efef8077-da78-4d89-8170-c5e1b226550c', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733504.536754) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:38:24.537967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:24.541933 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:38:24.542431 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:38:24.543582 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:38:24.545707 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:38:24.545931 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:38:24.547121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:38:24.547497 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-14T04:38:10Z,direct_url=<?>,disk_format='raw',id=efef8077-da78-4d89-8170-c5e1b226550c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1723630228',owner='21106f072baf4c4e8fcdb07b6c3a766a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-14T04:38:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:38:24.547721 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:38:24.547877 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:38:24.548055 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:38:24.548194 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:38:24.552665 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:38:24.552912 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:38:24.553084 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:38:24.553267 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:38:24.553429 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:38:24.553602 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:38:24.562811 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:38:24.564361 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:38:24.565997 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:24.566332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:24.566502 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:24.571837 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:38:24.572690 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:24.631070 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:24.631420 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12871MB free_disk=72.76136779785156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:38:24.631629 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:24.632010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:24.649521 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:24.685322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.119s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:24.685894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:24.699788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:24.700632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:24.700632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:24.700859 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:24.701193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:24.701390 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:24.717530 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:24.717530 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:24.718044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:24.718044 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:24.730304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7] added
May 14 04:38:24.730304 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:24.730304 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:24.730304 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:24.730304 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:24.730304 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:24.730304 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:24.730523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:24.730690 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:24.730863 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:24.733407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7] added
May 14 04:38:24.733407 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:24.733407 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:24.733407 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:24.733407 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:24.733407 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:24.733407 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:24.733546 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:24.733755 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:24.733893 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:24.799000 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:24.919641 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updated VIF entry in instance network info cache for port ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:38:24.919641 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating instance_info_cache with network_info: [{"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:25.423505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f1978489-ca99-4610-b4c1-bfa534d877ff req-979374c5-cab8-4273-b850-abbd5289f5b4 service nova] Releasing lock "refresh_cache-41d002ce-8b67-4716-ad8c-950e02e6fa43" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:25.698569 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 2129e698-f081-4a1b-ab59-fe36409dfe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:38:25.698945 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:38:25.699007 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:38:25.699082 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:38:25.699191 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:38:25.699579 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:38:25.699579 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:38:24 up 38 min,  2 users,  load average: 5.12, 6.99, 5.25\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '2', 'io_workload': '1', 'num_proj_7f729528c329420ba9589c48372a9bf0': '1', 'num_proj_7c56a1dd0473425da8eddafc3d4c27a7': '1', 'num_proj_8e458cafac3d48e99410f3bdfd372b6e': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:38:25.731334 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:25.734325 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:25.745336 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:25.745336 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:25.752483 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:25.752483 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.759829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.768161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.776039 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.776382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.785160 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.785329 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:25.816692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.50.100,3260]
May 14 04:38:25.816692 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.50.100,3260] successful.
May 14 04:38:25.816692 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.829517 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.836926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.40.100,3260]
May 14 04:38:25.836926 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.40.100,3260] successful.
May 14 04:38:25.836926 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.849605 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.849976 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:25.850251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:25.851010 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:25.852386 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:25.853445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('7', '-', '-', 0) found on session 146 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:25.853564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:25.870338 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:25.870338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:25.875210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('8', '-', '-', 0) found on session 147 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:25.875210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:25.875210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 146 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:25.875210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:25.886245 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 147 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:25.886308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:26.010596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:26.010596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:26.010596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:26.010596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No VIF found with MAC fa:16:3e:95:d5:73, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:26.065308 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:38:26.065670 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:38:26.312155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:26.568859 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:38:26.702498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:38:26.889450 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:27.077915 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:38:27.077915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.446s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:27.078259 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:27.569857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-65190a75-627b-4f2d-b21f-61381e382f18 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.483s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:27.627087 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:27.627341 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:27.720061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 3300000009dcd11fc for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:38:27.720339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:27.720496 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3153ms) {'type': 'block', 'scsi_wwn': '3300000009dcd11fc', 'path': '/dev/dm-0', 'multipath_id': '3300000009dcd11fc'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:27.720645 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009dcd11fc', 'path': '/dev/dm-0', 'multipath_id': '3300000009dcd11fc'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:38:27.828092 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.068487 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:28.068721 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:28.069006 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:28.069268 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.54 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:28.129852 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:38:28.239219 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-image-snapshot-server-1967685026',id=62,image_ref='efef8077-da78-4d89-8170-c5e1b226550c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuuGdcGB3451wfzyfLppC2Rlvmr3SP/8qd6ZErrPo0cyrnEITs3l36UrZrq0slLo8KfsOrzhyyMUPsldo/PkOTgC80HFobBkgr3Fa0NuPhHElLIhZDO9hZVdgcKbevLnw==',key_name='tempest-keypair-1639936117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-2fke738g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-948121274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=194ac0aa-d0dc-44cd-90b9-3e940f75fa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:38:28.239496 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:28.240330 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:28.241163 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:28.250782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:28.250927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:28.609805 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:28.610180 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:38:28.610180 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:38:28.610387 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:28.687524 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:28.687773 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:28.691867 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:38:28.691957 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Claim successful on node np0000000747
May 14 04:38:28.746310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] End _get_guest_xml xml=<domain type="qemu">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <uuid>194ac0aa-d0dc-44cd-90b9-3e940f75fa15</uuid>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <name>instance-0000003e</name>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1967685026</nova:name>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:38:24</nova:creationTime>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:diskFormat>raw</nova:diskFormat>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_machine_type">pc</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_video_model">virtio</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="img_bdm_v2">True</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid=""/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         <nova:port uuid="cdf3f9ae-9f2a-422b-ac00-c75985111df3">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <system>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="serial">194ac0aa-d0dc-44cd-90b9-3e940f75fa15</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="uuid">194ac0aa-d0dc-44cd-90b9-3e940f75fa15</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </system>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <os>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </os>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <features>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </features>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   <devices>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/disk.config"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <alias name="ua-ffa5538a-4970-4eda-8fad-3c2dc93db6a7"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <serial>ffa5538a-4970-4eda-8fad-3c2dc93db6a7</serial>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ca:e3:00"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <target dev="tapcdf3f9ae-9f"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </interface>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/console.log" append="off"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </serial>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <video>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </video>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </rng>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:   </devices>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]: </domain>
May 14 04:38:28.746310 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Preparing to wait for external event network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-image-snapshot-server-1967685026',id=62,image_ref='efef8077-da78-4d89-8170-c5e1b226550c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuuGdcGB3451wfzyfLppC2Rlvmr3SP/8qd6ZErrPo0cyrnEITs3l36UrZrq0slLo8KfsOrzhyyMUPsldo/PkOTgC80HFobBkgr3Fa0NuPhHElLIhZDO9hZVdgcKbevLnw==',key_name='tempest-keypair-1639936117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-2fke738g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-948121274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=194ac0aa-d0dc-44cd-90b9-3e940f75fa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:28.750234 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:38:28.750555 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.750555 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:28.750855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:38:28.752062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.752309 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fed00ec0-0188-58b3-aa55-ace9b226ffc4', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:28.753074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.753988 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:28.754498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.757191 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:28.759442 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.759442 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdf3f9ae-9f, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:28.759732 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdf3f9ae-9f, col_values=(('qos', UUID('49c2b3d5-2fd2-4cc2-8e28-94efdb8d2292')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:28.759972 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdf3f9ae-9f, col_values=(('external_ids', {'iface-id': 'cdf3f9ae-9f2a-422b-ac00-c75985111df3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:e3:00', 'vm-uuid': '194ac0aa-d0dc-44cd-90b9-3e940f75fa15'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:28.760681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.762165 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:28.767659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:28.768663 np0000000747 nova-compute[97971]: INFO os_vif [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f')
May 14 04:38:29.574264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:29.762688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:30.038787 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:38:30.039145 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:38:30.286668 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:30.286831 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:30.286886 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:ca:e3:00, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:30.287512 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Using config drive
May 14 04:38:30.541316 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:38:30.794925 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:30.824511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:30.824511 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:30.824727 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attaching volume 6e67a4d9-b119-4aea-9a4c-9314da053fad to /dev/vdc
May 14 04:38:30.864303 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:30.875218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:30.903542 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:30.955596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:30.955950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:30.970498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:30.971906 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe95:d573', 'fe80::a46e:cfff:fee0:8f7d', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feaf:9e7c', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:38:30.971906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:30.972012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:30.972271 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:30.972527 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating existing volume attachment record: 853c92a2-b02e-4a15-968c-9aff8fff7d68 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:31.008516 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Creating config drive at /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/disk.config
May 14 04:38:31.021776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp81ykal1b {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:31.059092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.369s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:31.060132 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:38:31.094403 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp81ykal1b" returned: 0 in 0.074s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:31.115529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.120381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:31.124011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:31.316411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.503894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.534716 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.550151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:31.550724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:31.550860 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:31.551274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:31.551523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:31.565010 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:31.565555 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:31.565941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:31.569791 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:31.576580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.011s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:31.576803 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:31.577299 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:38:31.577516 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:38:31.577981 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:31.578311 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:31.582944 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:31.582944 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:31.594677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:31.594677 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad] added
May 14 04:38:31.599503 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:31.599503 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:31.599503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:31.599821 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:31.599861 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:31.604817 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad] added
May 14 04:38:31.604817 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:31.604817 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:31.604817 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:31.604817 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:31.604817 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:31.604817 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:31.605055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:31.605055 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:31.605167 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:31.613481 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.627061 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:31.640647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.641903 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:31.658474 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaff71e5b25c4613a1f0c37315701570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f2a515353b48c6b1a74fd3510fd9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:38:32.053960 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Successfully created port: b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:38:32.076892 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:38:32.229476 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733512.229113, 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:32.229797 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] VM Started (Lifecycle Event)
May 14 04:38:32.468135 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Successfully updated port: b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:38:32.518186 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-changed-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:32.518660 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Refreshing instance network info cache due to event network-changed-b62e44df-b14a-405b-86c0-b33efc162320. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:32.518818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] Acquiring lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:32.518925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] Acquired lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:32.519023 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Refreshing network info cache for port b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:32.579630 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:38:32.600640 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:32.605680 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:32.613611 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:32.613611 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:32.621059 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:32.621059 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.627068 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.632210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:32.635681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.642511 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.651378 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:32.689167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.40.100,3260]
May 14 04:38:32.689167 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.40.100,3260] successful.
May 14 04:38:32.689167 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.698574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.50.100,3260]
May 14 04:38:32.698574 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.50.100,3260] successful.
May 14 04:38:32.698574 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.705061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.711311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.723295 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.726196 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('15', '-', '-', 0) found on session 148 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:32.726196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:32.731965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.732479 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:32.733920 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:32.733920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:32.734601 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733512.7344038, 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:32.734759 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] VM Paused (Lifecycle Event)
May 14 04:38:32.737348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] HCTL ('16', '-', '-', 0) found on session 149 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:32.737348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:32.769506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 148 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:32.769506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:32.769506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Searching for a device in session 149 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:32.769506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:32.969963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:33.021003 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:33.080288 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:33.211786 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:33.237266 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:33.238973 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:33.577327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:38:33.590694 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:38:33.591494 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:38:33.591731 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Creating image(s)
May 14 04:38:33.592132 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:33.592300 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:33.596092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:33.596754 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:33.603828 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:33.609019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:33.702170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:33.702486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:33.702882 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attaching volume 621efb10-837d-4245-8036-72259e61848d to /dev/vdb
May 14 04:38:33.705791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:33.706166 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:33.706514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:33.706940 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:33.709732 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:38:33.710018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:33.726371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-201ccaed-3764-408c-9910-5ea30046c29e req-0616a42c-eda7-46d9-a809-f2092164727d service nova] Releasing lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:33.728016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquired lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:33.728392 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:38:33.744111 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:38:33.760996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:33.777472 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:33.787930 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:33.807212 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:33.830900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.120s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:33.831633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:33.849871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:33.850289 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe95:d573', 'fe80::a46e:cfff:fee0:8f7d', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feaf:9e7c', 'fe80::f882:feff:fe18:2ed4', 'fe80::fc16:3eff:feca:e300'] 
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:33.862949 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating existing volume attachment record: 542d0e13-da4b-4aaf-8f84-20ab4810161f {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:33.889258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk 1073741824" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:33.889791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:33.890117 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:34.001073 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:34.001514 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:38:34.001807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:34.086344 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:34.086853 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Cannot resize image /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:38:34.087521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:38:34.087521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Ensure instance console log exists: /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:38:34.087644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:34.087788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:34.087935 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:34.286703 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:38:34.418608 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:34.428058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:34.428558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:34.428804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:34.527220 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating instance_info_cache with network_info: [{"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:34.594881 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found WWN 330000000a06c4df7 for multipath device dm-10 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:38:34.595351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:34.595544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000a06c4df7', 'path': '/dev/dm-10', 'multipath_id': '330000000a06c4df7'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:34.595761 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a06c4df7', 'path': '/dev/dm-10', 'multipath_id': '330000000a06c4df7'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:38:34.596167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.167s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:34.596348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:34.598534 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:34.609583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:34.610455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:34.610818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:34.611078 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:34.612436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:34.612773 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:34.624635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:34.624635 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:34.629870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:34.629870 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:34.637757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d] added
May 14 04:38:34.637757 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:34.637757 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:34.637757 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:34.637757 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:34.637757 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:34.637757 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:34.637953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:34.638078 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:34.638219 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:34.646200 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d] added
May 14 04:38:34.646200 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:34.646200 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:34.646200 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:34.646200 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:34.646200 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:34.646200 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:34.646415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:34.646497 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:34.646651 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:35.029639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Releasing lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:35.029924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance network_info: |[{"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:38:35.031445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Start _get_guest_xml network_info=[{"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:38:35.033997 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:38:35.035282 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1486398516', uuid='7908a07e-77be-4c7c-89f9-3a5247e79251'), owner=OwnerMeta(userid='aaff71e5b25c4613a1f0c37315701570', username='tempest-TestEncryptedCinderVolumes-100611717-project-member', projectid='e4f2a515353b48c6b1a74fd3510fd9ac', projectname='tempest-TestEncryptedCinderVolumes-100611717'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733515.0349278) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:38:35.037878 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:38:35.038221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:38:35.039688 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:38:35.039905 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:38:35.040985 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:38:35.041338 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:38:35.041498 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:38:35.041631 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:38:35.041786 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:38:35.041904 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:38:35.042032 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:38:35.042244 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:38:35.042398 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:38:35.042558 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:38:35.042856 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:38:35.043016 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:38:35.054303 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1486398516',display_name='tempest-TestEncryptedCinderVolumes-server-1486398516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1486398516',id=63,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudaeN6/W67H8ZFBaRULkTYJIvFnf7jjJdDQ8gVzcKpLavO7UHlWb3bnZHcGUKq3jI7KgDRbRb442xApAlewORAv0H6N+5Azndq2M5k9Ez0KCGzCZBu2K9bOa0GACi2+w==',key_name='tempest-keypair-1810141524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-c0zg3qpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaff71e5b25c4613a1f0c37315701570',uuid=7908a07e-77be-4c7c-89f9-3a5247e79251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:38:35.054500 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:35.055088 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:35.055623 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'pci_devices' on Instance uuid 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:35.101384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attempting to attach volume 6e67a4d9-b119-4aea-9a4c-9314da053fad with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:38:35.102806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:   <alias name="ua-6e67a4d9-b119-4aea-9a4c-9314da053fad"/>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-10"/>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:   <serial>6e67a4d9-b119-4aea-9a4c-9314da053fad</serial>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:35.102806 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:38:35.558227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] End _get_guest_xml xml=<domain type="qemu">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <uuid>7908a07e-77be-4c7c-89f9-3a5247e79251</uuid>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <name>instance-0000003f</name>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1486398516</nova:name>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:38:35</nova:creationTime>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:user uuid="aaff71e5b25c4613a1f0c37315701570">tempest-TestEncryptedCinderVolumes-100611717-project-member</nova:user>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:project uuid="e4f2a515353b48c6b1a74fd3510fd9ac">tempest-TestEncryptedCinderVolumes-100611717</nova:project>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         <nova:port uuid="b62e44df-b14a-405b-86c0-b33efc162320">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <system>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="serial">7908a07e-77be-4c7c-89f9-3a5247e79251</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="uuid">7908a07e-77be-4c7c-89f9-3a5247e79251</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </system>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <os>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </os>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <features>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </features>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   <devices>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.config"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </disk>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:d0:11:2b"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <target dev="tapb62e44df-b1"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </interface>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/console.log" append="off"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </serial>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <video>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </video>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </rng>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:   </devices>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]: </domain>
May 14 04:38:35.558227 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Preparing to wait for external event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1486398516',display_name='tempest-TestEncryptedCinderVolumes-server-1486398516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1486398516',id=63,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudaeN6/W67H8ZFBaRULkTYJIvFnf7jjJdDQ8gVzcKpLavO7UHlWb3bnZHcGUKq3jI7KgDRbRb442xApAlewORAv0H6N+5Azndq2M5k9Ez0KCGzCZBu2K9bOa0GACi2+w==',key_name='tempest-keypair-1810141524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-c0zg3qpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaff71e5b25c4613a1f0c37315701570',uuid=7908a07e-77be-4c7c-89f9-3a5247e79251,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:38:35.560000 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:35.560457 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:35.560786 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:38:35.561132 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.561391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:35.561695 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:38:35.562362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.562517 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7928979-0155-5d7d-897b-5c45d1da945f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:35.563290 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.564015 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:35.565208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.568013 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.568224 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb62e44df-b1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:35.568698 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb62e44df-b1, col_values=(('qos', UUID('7f2e9999-5765-43fa-8c8d-561612a48882')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:35.568927 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb62e44df-b1, col_values=(('external_ids', {'iface-id': 'b62e44df-b14a-405b-86c0-b33efc162320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:11:2b', 'vm-uuid': '7908a07e-77be-4c7c-89f9-3a5247e79251'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:35.569941 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.572621 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:35.577207 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:35.578151 np0000000747 nova-compute[97971]: INFO os_vif [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1')
May 14 04:38:35.581688 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:38:35.638651 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:35.646951 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:35.654030 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:35.654030 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:35.661645 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:35.661645 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.667692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.674922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.683436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.683945 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.699284 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.699550 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:35.727850 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.50.100,3260]
May 14 04:38:35.727850 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.50.100,3260] successful.
May 14 04:38:35.727850 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.743809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.758106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.40.100,3260]
May 14 04:38:35.758106 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.40.100,3260] successful.
May 14 04:38:35.758106 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.765383 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.765804 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:35.765804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:35.766124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:35.767308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('17', '-', '-', 0) found on session 150 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:35.767405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:35.772838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:35.782952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 150 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:35.783123 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.793241 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:35.793573 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:35.793821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:35.793821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:35.794987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('18', '-', '-', 0) found on session 151 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:35.795097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:35.812065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 151 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:35.812246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:36.318386 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:36.610971 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:38:36.749774 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:36.749957 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:36.750101 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:36.750236 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:36.750375 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] No VIF found with MAC fa:16:3e:95:d5:73, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:37.093266 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:37.093399 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:37.093509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No VIF found with MAC fa:16:3e:d0:11:2b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:37.093975 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Using config drive
May 14 04:38:37.104834 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-36cdc2ae-9d68-4abe-b0a4-0b54a56028e9 req-cd760819-2393-4a1c-bd21-79651ff996a1 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:37.104998 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36cdc2ae-9d68-4abe-b0a4-0b54a56028e9 req-cd760819-2393-4a1c-bd21-79651ff996a1 service nova] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:37.105149 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36cdc2ae-9d68-4abe-b0a4-0b54a56028e9 req-cd760819-2393-4a1c-bd21-79651ff996a1 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:37.105279 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-36cdc2ae-9d68-4abe-b0a4-0b54a56028e9 req-cd760819-2393-4a1c-bd21-79651ff996a1 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:37.105410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-36cdc2ae-9d68-4abe-b0a4-0b54a56028e9 req-cd760819-2393-4a1c-bd21-79651ff996a1 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Processing event network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:38:37.106208 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:38:37.109284 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733517.1088881, 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:37.109450 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] VM Resumed (Lifecycle Event)
May 14 04:38:37.112918 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:38:37.115485 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance spawned successfully.
May 14 04:38:37.115485 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:38:37.118521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:37.118883 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:37.599781 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:37.614436 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:37.616336 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:37.623524 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Took 13.10 seconds to spawn the instance on the hypervisor.
May 14 04:38:37.623700 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:37.630978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found WWN 3300000008a47766f for multipath device dm-11 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:38:37.631242 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:37.631394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== connect_volume: return (3202ms) {'type': 'block', 'scsi_wwn': '3300000008a47766f', 'path': '/dev/dm-11', 'multipath_id': '3300000008a47766f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:37.631518 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a47766f', 'path': '/dev/dm-11', 'multipath_id': '3300000008a47766f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:38:37.634131 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:37.724750 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Creating config drive at /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.config
May 14 04:38:37.729835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazkff4n6 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:37.793047 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazkff4n6" returned: 0 in 0.063s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:38:38.118564 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:38:38.137927 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attempting to attach volume 621efb10-837d-4245-8036-72259e61848d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:38:38.141801 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Took 23.19 seconds to build instance.
May 14 04:38:38.148316 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:   <alias name="ua-621efb10-837d-4245-8036-72259e61848d"/>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-11"/>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:   <serial>621efb10-837d-4245-8036-72259e61848d</serial>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:38.148316 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:38:38.206252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.237279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.313024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-cf3d6153-e7c3-4941-862e-a5c03236742c tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.488s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:38.423324 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.513992 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.519285 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.523715 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.544607 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:38.644488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-d8922f48-8af1-49c5-9761-49d2c579db04 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.705s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:39.144240 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733519.1438737, 7908a07e-77be-4c7c-89f9-3a5247e79251 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:39.144497 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] VM Started (Lifecycle Event)
May 14 04:38:39.222472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:39.223023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:39.223250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:39.223404 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:39.223636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] No waiting events found dispatching network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:39.223811 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received unexpected event network-vif-plugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 for instance with vm_state active and task_state None.
May 14 04:38:39.223968 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:39.224159 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:39.224315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:39.224476 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:39.224667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No event matching network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 in dict_keys([('network-vif-plugged', 'b62e44df-b14a-405b-86c0-b33efc162320')]) {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 14 04:38:39.224785 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received unexpected event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with vm_state building and task_state spawning.
May 14 04:38:39.225152 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:39.225274 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:39.225391 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:39.225490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:39.225628 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Processing event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:38:39.225775 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:39.225908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:39.227256 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:38:39.227521 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:39.227655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:39.227723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:39.227917 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-b66bc065-8900-47eb-bc96-18177a3c8686 req-0647e61a-8d8b-43b0-bfad-9a6d1279cb38 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received unexpected event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with vm_state building and task_state spawning.
May 14 04:38:39.231388 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:38:39.232848 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance spawned successfully.
May 14 04:38:39.233126 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:38:39.648074 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:39.650471 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:39.739160 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.739326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.739643 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.739967 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.740282 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.740626 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:38:39.956326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:39.956326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:39.956326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:39.956326 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:75:da:32, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:40.152712 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:38:40.152950 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733520.1527293, 7908a07e-77be-4c7c-89f9-3a5247e79251 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:40.153113 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] VM Paused (Lifecycle Event)
May 14 04:38:40.247113 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Took 6.66 seconds to spawn the instance on the hypervisor.
May 14 04:38:40.247243 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:40.574731 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:40.656084 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:40.659270 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733520.6589677, 7908a07e-77be-4c7c-89f9-3a5247e79251 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:38:40.659401 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] VM Resumed (Lifecycle Event)
May 14 04:38:40.768244 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Took 12.13 seconds to build instance.
May 14 04:38:41.162124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:38:41.164408 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:38:41.270247 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.643s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:41.292856 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-changed-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:41.293015 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Refreshing instance network info cache due to event network-changed-cdf3f9ae-9f2a-422b-ac00-c75985111df3. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:41.293182 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] Acquiring lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:41.293290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] Acquired lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:41.293446 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Refreshing network info cache for port cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:41.322156 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:41.508783 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-40952fe6-9c15-4237-ab8d-22f0111b11e8 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.806s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:41.796676 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:42.202856 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:42.372520 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updated VIF entry in instance network info cache for port cdf3f9ae-9f2a-422b-ac00-c75985111df3. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:38:42.372989 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating instance_info_cache with network_info: [{"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:42.875053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-4f874154-bfa2-42e1-b391-ce2c61a5ffb0 req-7af6fcc2-a976-4cdb-89ba-cafd811b6c8a service nova] Releasing lock "refresh_cache-194ac0aa-d0dc-44cd-90b9-3e940f75fa15" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:43.357129 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-changed-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:43.357324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Refreshing instance network info cache due to event network-changed-b62e44df-b14a-405b-86c0-b33efc162320. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:43.357636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] Acquiring lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:43.357717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] Acquired lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:43.357859 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Refreshing network info cache for port b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:43.504308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:43.507898 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:43.516167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:43.516324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:43.861947 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:44.011448 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:44.021018 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Detaching volume c522dcda-f796-4983-b934-3977a6951288
May 14 04:38:44.086998 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attempting to driver detach volume c522dcda-f796-4983-b934-3977a6951288 from mountpoint /dev/vdb
May 14 04:38:44.096022 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found disk vdb by alias ua-c522dcda-f796-4983-b934-3977a6951288 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:44.097977 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found disk vdb by alias ua-c522dcda-f796-4983-b934-3977a6951288 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:44.098096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Attempting to detach device vdb from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:38:44.098314 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <alias name="ua-c522dcda-f796-4983-b934-3977a6951288"/>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <serial>c522dcda-f796-4983-b934-3977a6951288</serial>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:44.098314 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:44.104764 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully detached device vdb from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the persistent domain config.
May 14 04:38:44.105445 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] (1/8): Attempting to detach device vdb with device alias ua-c522dcda-f796-4983-b934-3977a6951288 from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:38:44.105724 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <alias name="ua-c522dcda-f796-4983-b934-3977a6951288"/>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <serial>c522dcda-f796-4983-b934-3977a6951288</serial>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:44.105724 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:44.213958 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:44.356712 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updated VIF entry in instance network info cache for port b62e44df-b14a-405b-86c0-b33efc162320. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:38:44.356712 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating instance_info_cache with network_info: [{"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:44.623066 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733524.6227472, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => ua-c522dcda-f796-4983-b934-3977a6951288> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:38:44.627423 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c522dcda-f796-4983-b934-3977a6951288 for instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:38:44.631587 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully detached device vdb from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the live domain config.
May 14 04:38:44.633555 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:38:44.634039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:44.634248 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:44.634602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:44.634968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c522dcda-f796-4983-b934-3977a6951288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:38:44.635148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:44.668688 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:44.668978 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:44.668978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30', '152')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:38:44.669260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', '145')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:44.670328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288', '144')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:44.671258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e16c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:38:44.671457 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:38:44.672297 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Flush multipath device 3300000003107ff6c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:38:44.709653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:44.750044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:44.782093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:38:44.782254 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:38:44.784049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:38:44.796666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:38:44.796850 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:38:44.807720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.847365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.40.100,3260]
May 14 04:38:44.847365 np0000000747 nova-compute[97971]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.40.100,3260] successful.
May 14 04:38:44.847365 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.857036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1e84cd0a-0c90-468c-b7dc-9a2f05712e07 req-e3f308fa-b44f-4738-a10f-7e4df7e006b6 service nova] Releasing lock "refresh_cache-7908a07e-77be-4c7c-89f9-3a5247e79251" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:44.868013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.880357 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.924205 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.50.100,3260]
May 14 04:38:44.924205 np0000000747 nova-compute[97971]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-c522dcda-f796-4983-b934-3977a6951288, portal: 192.168.50.100,3260] successful.
May 14 04:38:44.924205 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.945415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:44.945717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:44.945859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== disconnect_volume: return (311ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:44.946050 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:38:45.020855 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:45.491173 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:45.577201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:46.218036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:46.218036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:46.220881 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attaching volume d9ea3927-0ce9-4c89-b48e-b01076fde88e to /dev/vdc
May 14 04:38:46.276719 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:46.292181 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:46.315819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:46.335679 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:46.373234 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:46.373534 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:46.382848 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:46.384214 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe95:d573', 'fe80::a46e:cfff:fee0:8f7d', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feaf:9e7c', 'fe80::f882:feff:fe18:2ed4', 'fe80::fc16:3eff:feca:e300', 'fe80::fc16:3eff:fed0:112b', 'fe80::b038:ddff:fe7e:750d'] 
May 14 04:38:46.384432 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:46.384597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:46.384873 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:46.385137 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating existing volume attachment record: 381bad35-afbc-44e9-80a4-bd85b6ad1ce2 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:46.497361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-3ddd096a-836e-41f1-9f76-0498a83704e1 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.981s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:46.944770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:46.945434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:46.945774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:46.946324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:46.946695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:46.961754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:46.962700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:46.963139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:46.963297 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:46.964016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:46.964016 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:46.980028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:46.980028 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:46.980495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:46.980495 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:46.993089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e] added
May 14 04:38:46.993089 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:46.993089 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:46.993089 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:46.993089 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:46.993089 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:46.993089 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:46.994229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:46.994229 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:46.994229 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:46.997879 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e] added
May 14 04:38:46.997879 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:46.997879 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:46.997879 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:46.997879 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:46.997879 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:46.997879 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:46.998058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:46.998182 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:46.998299 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:47.994670 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:47.998825 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:48.008732 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:48.008732 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:48.016411 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:48.016411 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.028230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.034716 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.054234 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.055313 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:48.102422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.50.100,3260]
May 14 04:38:48.102422 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.50.100,3260] successful.
May 14 04:38:48.102422 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.125795 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.134889 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.40.100,3260]
May 14 04:38:48.134889 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.40.100,3260] successful.
May 14 04:38:48.134889 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.148442 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('13', '-', '-', 0) found on session 153 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:48.148442 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:48.152976 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:48.166472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 153 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:48.167023 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.179238 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:48.180185 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:48.183319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:48.183319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:48.183319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] HCTL ('14', '-', '-', 0) found on session 154 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:48.183319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:48.201573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Searching for a device in session 154 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:48.201573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:48.963672 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:38:49.986125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found WWN 33000000055f3a55a for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:38:49.986600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:49.986600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000055f3a55a', 'path': '/dev/dm-1', 'multipath_id': '33000000055f3a55a'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:49.986827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000055f3a55a', 'path': '/dev/dm-1', 'multipath_id': '33000000055f3a55a'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:38:49.990255 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:50.493805 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attempting to attach volume d9ea3927-0ce9-4c89-b48e-b01076fde88e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:38:50.495245 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:   <alias name="ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e"/>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:   <serial>d9ea3927-0ce9-4c89-b48e-b01076fde88e</serial>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:50.495245 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:38:50.587197 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:51.328884 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:51.680027 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:51.680251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:52.150914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:52.150914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:52.150914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:52.150914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:38:52.151503 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] No VIF found with MAC fa:16:3e:75:da:32, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:38:52.182733 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Detaching volume 6e67a4d9-b119-4aea-9a4c-9314da053fad
May 14 04:38:52.229725 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Attempting to driver detach volume 6e67a4d9-b119-4aea-9a4c-9314da053fad from mountpoint /dev/vdc
May 14 04:38:52.234298 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found disk vdc by alias ua-6e67a4d9-b119-4aea-9a4c-9314da053fad {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:52.235557 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Found disk vdc by alias ua-6e67a4d9-b119-4aea-9a4c-9314da053fad {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:52.235755 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Attempting to detach device vdc from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:38:52.236033 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <alias name="ua-6e67a4d9-b119-4aea-9a4c-9314da053fad"/>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-10"/>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <serial>6e67a4d9-b119-4aea-9a4c-9314da053fad</serial>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:52.236033 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:52.250568 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully detached device vdc from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the persistent domain config.
May 14 04:38:52.250747 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] (1/8): Attempting to detach device vdc with device alias ua-6e67a4d9-b119-4aea-9a4c-9314da053fad from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:38:52.251069 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <alias name="ua-6e67a4d9-b119-4aea-9a4c-9314da053fad"/>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-10"/>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <serial>6e67a4d9-b119-4aea-9a4c-9314da053fad</serial>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:52.251069 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:52.771011 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733532.7706025, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => ua-6e67a4d9-b119-4aea-9a4c-9314da053fad> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:38:52.772968 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-6e67a4d9-b119-4aea-9a4c-9314da053fad for instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:38:52.774996 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully detached device vdc from instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee from the live domain config.
May 14 04:38:52.776042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:38:52.776359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:52.776536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:52.776889 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:52.777227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e67a4d9-b119-4aea-9a4c-9314da053fad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:38:52.777372 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:52.817379 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30 (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:52.819739 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7728bc6-611a-45b8-a325-e379b5075d30', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '154')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '148')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:52.819739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad', '149')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:52.820421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8497920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'): ({'sdk'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:38:52.820421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:38:52.820421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Flush multipath device 330000000a06c4df7 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:38:52.854310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:52.908355 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:52.951500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:38:52.951757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:38:52.954202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:38:52.967927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:38:52.968118 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:38:52.982101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.020581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.40.100,3260]
May 14 04:38:53.020581 np0000000747 nova-compute[97971]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.40.100,3260] successful.
May 14 04:38:53.020581 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.045836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.059314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.093116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.50.100,3260]
May 14 04:38:53.093116 np0000000747 nova-compute[97971]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-6e67a4d9-b119-4aea-9a4c-9314da053fad, portal: 192.168.50.100,3260] successful.
May 14 04:38:53.093116 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.113439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:53.113588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:53.113765 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== disconnect_volume: return (337ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:53.113833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:38:53.665284 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'flavor' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:53.704924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a0e691e4-bd2e-419a-ad02-1d36f809d6f0 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.487s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:54.258637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:54.259131 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:54.439901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:54.440419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:54.670089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f75760ad-6e44-4e9b-90a8-3d643047e6a5 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.990s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:54.761064 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Detaching volume 621efb10-837d-4245-8036-72259e61848d
May 14 04:38:54.796450 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attempting to driver detach volume 621efb10-837d-4245-8036-72259e61848d from mountpoint /dev/vdb
May 14 04:38:54.801028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdb by alias ua-621efb10-837d-4245-8036-72259e61848d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:54.802116 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdb by alias ua-621efb10-837d-4245-8036-72259e61848d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:54.802218 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Attempting to detach device vdb from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:38:54.802409 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <alias name="ua-621efb10-837d-4245-8036-72259e61848d"/>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-11"/>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <serial>621efb10-837d-4245-8036-72259e61848d</serial>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:54.802409 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:54.807346 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdb from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the persistent domain config.
May 14 04:38:54.807458 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] (1/8): Attempting to detach device vdb with device alias ua-621efb10-837d-4245-8036-72259e61848d from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:38:54.807684 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <alias name="ua-621efb10-837d-4245-8036-72259e61848d"/>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-11"/>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <serial>621efb10-837d-4245-8036-72259e61848d</serial>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:54.807684 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:54.943874 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:55.032932 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-changed-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:55.033930 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing instance network info cache due to event network-changed-23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:55.034123 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:55.034215 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:55.034396 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing network info cache for port 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:55.160552 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:55.322500 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733535.3221736, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => ua-621efb10-837d-4245-8036-72259e61848d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:38:55.324158 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-621efb10-837d-4245-8036-72259e61848d for instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:38:55.326793 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdb from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the live domain config.
May 14 04:38:55.327805 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:38:55.328131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:55.328301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:55.328597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:55.328877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '621efb10-837d-4245-8036-72259e61848d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:38:55.329035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:55.357897 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:55.358276 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:55.358276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '154')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:38:55.358633 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '151')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:55.359368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d', '150')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:55.360258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7436184ccae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'): ({'sdl'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:38:55.360489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Removing multipathed devices sdm, sdl {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:38:55.360846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flush multipath device 3300000008a47766f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:38:55.397155 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:55.452027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:55.496580 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-changed-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:55.497838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing instance network info cache due to event network-changed-23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:38:55.498121 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] Acquiring lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:38:55.499393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:38:55.499841 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:38:55.501410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:38:55.513801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:38:55.514105 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:38:55.526959 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.536442 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:55.564499 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.40.100,3260]
May 14 04:38:55.564499 np0000000747 nova-compute[97971]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.40.100,3260] successful.
May 14 04:38:55.564499 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.586114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.589789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:55.597729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.641394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.50.100,3260]
May 14 04:38:55.641394 np0000000747 nova-compute[97971]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-621efb10-837d-4245-8036-72259e61848d, portal: 192.168.50.100,3260] successful.
May 14 04:38:55.641394 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.660533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:55.660813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:55.660965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== disconnect_volume: return (332ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:55.661115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:38:55.850685 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:55.949382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:55.970756 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updated VIF entry in instance network info cache for port 23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:38:55.971040 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:56.023257 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:56.023483 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:56.023588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:56.023750 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:56.023846 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:56.025768 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Terminating instance
May 14 04:38:56.209077 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:56.331989 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.472812 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d02daef6-dad6-4619-aa56-25d7a7eddc19 req-805080ca-1865-42c2-ba29-ca27d385eabe service nova] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:56.473215 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] Acquired lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:38:56.473353 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Refreshing network info cache for port 23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:38:56.528661 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:38:56.549767 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.552645 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.575144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.595054 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.599628 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] No waiting events found dispatching network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:56.733544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-58bd0238-6df3-41dd-85ae-96e5494bae5a req-292c6cec-882e-4116-81aa-bf554f8ea5fc service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:38:56.850931 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99970323999969 future=<Future at 0x7435f82199d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:56.851855 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99873904099968 future=<Future at 0x7435f82199d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:56.852238 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998497622999821 future=<Future at 0x7435f82199d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:38:56.852878 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Instance destroyed successfully.
May 14 04:38:56.853240 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lazy-loading 'resources' on Instance uuid 87bad06f-f93f-449d-b7f3-adeb4a1767ee {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:38:56.976682 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:57.009001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:57.009189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:57.009368 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Attaching volume 5b495c6e-05af-4a2e-9d76-5ac0d1b89316 to /dev/vdb
May 14 04:38:57.050166 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:57.063156 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:38:57.083739 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:38:57.126023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:38:57.126695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:38:57.136174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:38:57.137965 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe75:da32', 'fe80::a00d:dfff:fe3b:1181', 'fe80::fc16:3eff:feaf:9e7c', 'fe80::f882:feff:fe18:2ed4', 'fe80::fc16:3eff:feca:e300', 'fe80::fc16:3eff:fed0:112b', 'fe80::b038:ddff:fe7e:750d'] 
May 14 04:38:57.138108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:38:57.138165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:38:57.138407 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:57.138669 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating existing volume attachment record: 59494f1e-27c1-4a61-ad12-43366b6ce0e5 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:38:57.215745 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21a11c59-3500-4381-83ac-52d6b6171f36 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:57.245024 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:57.355895 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-424521620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testinstanceswithcindervolumes-server-424521620',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDgb8s1wbKy6IoR+2kyeaolv32X7/uukwGy0VIh3nMwhnOGR6mrXxoO0kwOuyzEsWyiRu1E8/BAtUWH6sX7RgI5gfErpCQ9mtKwSfkJ6mo+0kLEw1QFUxBofhSTsIQk8Q==',key_name='tempest-TestInstancesWithCinderVolumes-404292981',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:37:50Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f729528c329420ba9589c48372a9bf0',ramdisk_id='',reservation_id='r-nfy1ro0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1242058295',owner_user_name='tempest-TestInstancesWithCinderVolumes-1242058295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:37:50Z,user_data=None,user_id='4cb12faaf3d144c3a097833825ae04dc',uuid=87bad06f-f93f-449d-b7f3-adeb4a1767ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:38:57.356371 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converting VIF {"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:38:57.356696 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:38:57.356948 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:38:57.358341 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:57.358652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23b94dab-67, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:57.371211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:57.372202 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:57.373506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:38:57.373689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9900276-d860-4a82-b2ef-ea52adc1fd4a) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:38:57.375271 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updated VIF entry in instance network info cache for port 23b94dab-67f7-492f-a363-92579411b25c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:38:57.375544 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [{"id": "23b94dab-67f7-492f-a363-92579411b25c", "address": "fa:16:3e:95:d5:73", "network": {"id": "b306a007-5236-43b1-b2b8-505d78cd1300", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-122556864-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f729528c329420ba9589c48372a9bf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b94dab-67", "ovs_interfaceid": "23b94dab-67f7-492f-a363-92579411b25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:57.377154 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:38:57.379545 np0000000747 nova-compute[97971]: INFO os_vif [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:d5:73,bridge_name='br-int',has_traffic_filtering=True,id=23b94dab-67f7-492f-a363-92579411b25c,network=Network(b306a007-5236-43b1-b2b8-505d78cd1300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b94dab-67')
May 14 04:38:57.382999 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:38:57.383318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:57.383474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:57.383825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:57.384087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36b77954-d0e8-47a7-b958-4047c5e9d12f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:38:57.384212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:57.409816 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:57.410085 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:57.410085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '154')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:38:57.410311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '139')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:57.411335 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f', '138')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:38:57.412279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618383c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:38:57.412512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:38:57.412759 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Flush multipath device 3300000002512bc16 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:38:57.459732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:57.513195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:38:57.530682 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:57.530858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:57.557914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:38:57.558090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:38:57.559455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:38:57.570016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:38:57.570229 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:38:57.582120 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.620785 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.40.100,3260]
May 14 04:38:57.620785 np0000000747 nova-compute[97971]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.40.100,3260] successful.
May 14 04:38:57.620785 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.637844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.648817 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.680800 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.50.100,3260]
May 14 04:38:57.680800 np0000000747 nova-compute[97971]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-36b77954-d0e8-47a7-b958-4047c5e9d12f, portal: 192.168.50.100,3260] successful.
May 14 04:38:57.680800 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.697925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.698175 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:57.698311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] <== disconnect_volume: return (314ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:38:57.698461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:38:57.698801 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Deleting instance files /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee_del
May 14 04:38:57.699394 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Deletion of /opt/stack/data/nova/instances/87bad06f-f93f-449d-b7f3-adeb4a1767ee_del complete
May 14 04:38:57.709223 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '41d002ce-8b67-4716-ad8c-950e02e6fa43', 'attached_at': '', 'detached_at': '', 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'serial': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:38:57.710592 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:38:57.710796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:57.710952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:57.711314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:57.711551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:38:57.722536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:57.723364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:57.723846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:57.724010 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:57.724602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:38:57.724890 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:57.735431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:57.735431 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.740481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:38:57.740481 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.746282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316] added
May 14 04:38:57.746282 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:57.746282 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:57.746282 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:57.746282 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:57.746282 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:57.746282 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.746509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:57.746589 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:57.746716 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:57.750307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316] added
May 14 04:38:57.750307 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:38:57.750307 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:57.750307 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:57.750307 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:38:57.750307 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:38:57.750307 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:57.750489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:38:57.750717 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:38:57.750892 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:38:57.877900 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-193fd5fd-f226-4c72-995c-9ad125c64998 req-c3c015ef-d339-49d9-b27f-a16983e6079e service nova] Releasing lock "refresh_cache-87bad06f-f93f-449d-b7f3-adeb4a1767ee" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:38:58.033231 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Detaching volume d9ea3927-0ce9-4c89-b48e-b01076fde88e
May 14 04:38:58.071071 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Attempting to driver detach volume d9ea3927-0ce9-4c89-b48e-b01076fde88e from mountpoint /dev/vdc
May 14 04:38:58.075322 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdc by alias ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:58.076796 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Found disk vdc by alias ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:38:58.076935 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Attempting to detach device vdc from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:38:58.077225 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <alias name="ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e"/>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <serial>d9ea3927-0ce9-4c89-b48e-b01076fde88e</serial>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:58.077225 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:58.083124 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdc from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the persistent domain config.
May 14 04:38:58.083284 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] (1/8): Attempting to detach device vdc with device alias ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:38:58.083578 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <alias name="ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e"/>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-1"/>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <serial>d9ea3927-0ce9-4c89-b48e-b01076fde88e</serial>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]: </disk>
May 14 04:38:58.083578 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:38:58.205567 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Took 1.68 seconds to destroy the instance on the hypervisor.
May 14 04:38:58.206261 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:38:58.206590 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:38:58.206711 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:38:58.206944 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:58.263731 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:38:58.491974 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-80696914-726f-4108-9d4a-0d16ece4415d req-05508c50-7f06-4094-80c0-76d0dbe1db6a service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-deleted-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:58.492419 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-80696914-726f-4108-9d4a-0d16ece4415d req-05508c50-7f06-4094-80c0-76d0dbe1db6a service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Neutron deleted interface 23b94dab-67f7-492f-a363-92579411b25c; detaching it from the instance and deleting it from the info cache
May 14 04:38:58.492628 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-80696914-726f-4108-9d4a-0d16ece4415d req-05508c50-7f06-4094-80c0-76d0dbe1db6a service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:58.543744 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733538.5433033, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:38:58.544785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-d9ea3927-0ce9-4c89-b48e-b01076fde88e for instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:38:58.547225 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully detached device vdc from instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 from the live domain config.
May 14 04:38:58.548252 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:38:58.548523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:38:58.548642 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:38:58.747205 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:38:58.751387 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:58.760577 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:58.760577 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:38:58.766328 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:38:58.766328 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.773637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.779318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.787955 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:38:58.788771 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] Acquiring lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:38:58.788946 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:38:58.789096 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.789725 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:58.789932 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] No waiting events found dispatching network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.790148 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:58.790392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fea2f58f-8ffc-463e-b491-cbf3df3942ab req-4ae326d4-7cb1-4a6f-ad6c-c22ea7ff3b7b service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Received event network-vif-unplugged-23b94dab-67f7-492f-a363-92579411b25c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.795817 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.795984 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:58.824017 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.40.100,3260]
May 14 04:38:58.824017 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.40.100,3260] successful.
May 14 04:38:58.824017 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.834796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.841117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.50.100,3260]
May 14 04:38:58.841117 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.50.100,3260] successful.
May 14 04:38:58.841117 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.849106 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.849460 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:58.849739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:58.849884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:58.850223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:38:58.851184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('11', '-', '-', 0) found on session 155 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:58.851307 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:58.864509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 155 and hctl ['11', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.867191 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:38:58.867382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:38:58.867673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:38:58.867804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:38:58.868824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('12', '-', '-', 0) found on session 156 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:38:58.868824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:38:58.880069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 156 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:58.880069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:58.948992 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:38:58.995580 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-80696914-726f-4108-9d4a-0d16ece4415d req-05508c50-7f06-4094-80c0-76d0dbe1db6a service nova] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Detach interface failed, port_id=23b94dab-67f7-492f-a363-92579411b25c, reason: Instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:38:59.450829 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Took 1.24 seconds to deallocate network for instance.
May 14 04:38:59.865144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 155 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:38:59.865593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:38:59.994204 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:39:00.499931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:00.500172 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:00.743028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found WWN 33000000093c9dd62 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:39:00.743376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:00.743956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.195s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:00.744366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9ea3927-0ce9-4c89-b48e-b01076fde88e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:39:00.744576 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:39:00.745100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000093c9dd62', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000093c9dd62'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:00.745255 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000093c9dd62', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000093c9dd62'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:39:00.747587 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:39:00.747814 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:00.747912 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:00.767848 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.luks [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 04:39:00.768321 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:39:00.768553 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:00.768766 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:00.769371 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7435f844dbe0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '41d002ce-8b67-4716-ad8c-950e02e6fa43', 'attached_at': '', 'detached_at': '', 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'serial': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:39:00.769564 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] formatting encrypted volume /dev/dm-6 {{(pid=97971) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 04:39:00.775917 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:00.776527 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:00.776862 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:00.777893 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:00.778193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '156')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:39:00.778293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '154')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:00.779322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e', '153')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:00.780350 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e0ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:39:00.780350 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:39:00.780627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Flush multipath device 33000000055f3a55a {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:39:00.829046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:00.879356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:00.926479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:39:00.926680 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:39:00.927746 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:39:00.939305 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:39:00.939542 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:39:00.951847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:00.983667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.40.100,3260]
May 14 04:39:00.983667 np0000000747 nova-compute[97971]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.40.100,3260] successful.
May 14 04:39:00.983667 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:00.999913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:01.009844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:01.044077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.50.100,3260]
May 14 04:39:01.044077 np0000000747 nova-compute[97971]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-d9ea3927-0ce9-4c89-b48e-b01076fde88e, portal: 192.168.50.100,3260] successful.
May 14 04:39:01.044077 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:01.067111 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:01.067349 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:01.067511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] <== disconnect_volume: return (2518ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:01.067764 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:39:01.279696 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:01.334328 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:01.612865 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'flavor' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:01.786293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.286s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:01.831327 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Deleted allocations for instance 87bad06f-f93f-449d-b7f3-adeb4a1767ee
May 14 04:39:02.394717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:02.620161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-50546a25-1367-4385-aa2f-285c79b0ed19 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.089s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:02.838378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a5598833-e6e7-480c-ba27-917795496989 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Lock "87bad06f-f93f-449d-b7f3-adeb4a1767ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.815s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:02.974772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:02.974991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:02.975078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:02.975208 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:02.975309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:02.977149 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Terminating instance
May 14 04:39:03.480437 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:39:03.507952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.528340 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.535253 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.563865 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.564562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.683376 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:03.683636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:03.683919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:03.684053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:03.684417 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] No waiting events found dispatching network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:03.684417 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-be333d8f-af8c-4c0d-be4c-08410d2cdbe9 req-4cbdb7a1-c212-45c3-824c-90da271fb723 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:03.796694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.804372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:03.835060 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999726481999915 future=<Future at 0x7435f8312480 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:03.837442 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Instance destroyed successfully.
May 14 04:39:03.838018 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lazy-loading 'resources' on Instance uuid e0dfd328-2cf0-4e24-b9b2-6860817d4537 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:04.344140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-63291331',display_name='tempest-AttachVolumeTestJSON-server-63291331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-attachvolumetestjson-server-63291331',id=60,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzOyS1Wo2Z9cLhJlEPFSevz/Do34U7YCgdj8urCP7AtPvTkFoOK7ctJnQGdCdfANHwykCmBjFkiq/NOrxyjfKbpsYJKqx67ij5Eu7A1gLo3QNQdbWq1FO8D+E9Y8zmtAg==',key_name='tempest-keypair-1510604320',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:37:51Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c56a1dd0473425da8eddafc3d4c27a7',ramdisk_id='',reservation_id='r-kn9zup00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-948226058',owner_user_name='tempest-AttachVolumeTestJSON-948226058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a74e809c82bf46ce93759af89887f6b7',uuid=e0dfd328-2cf0-4e24-b9b2-6860817d4537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:39:04.346627 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converting VIF {"id": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "address": "fa:16:3e:75:da:32", "network": {"id": "ff7e70d3-1707-45ab-8f4f-15016bd9bcf1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548326874-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7c56a1dd0473425da8eddafc3d4c27a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ecbd71b-c9", "ovs_interfaceid": "0ecbd71b-c99c-4a79-ac7a-2c1215782bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:04.347230 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:04.347511 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:39:04.354845 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:04.355102 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ecbd71b-c9, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:04.356452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:04.357278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:04.357494 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:04.358601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:04.358801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4b2ff74-e1c1-4bb9-a3d4-d4a9c9e79b91) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:04.359250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:04.359845 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:04.361629 np0000000747 nova-compute[97971]: INFO os_vif [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:da:32,bridge_name='br-int',has_traffic_filtering=True,id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6,network=Network(ff7e70d3-1707-45ab-8f4f-15016bd9bcf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ecbd71b-c9')
May 14 04:39:04.361927 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Deleting instance files /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537_del
May 14 04:39:04.362762 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Deletion of /opt/stack/data/nova/instances/e0dfd328-2cf0-4e24-b9b2-6860817d4537_del complete
May 14 04:39:04.625337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:39:04.625337 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:39:04.625337 np0000000747 nova-compute[97971]:     <volume>5b495c6e-05af-4a2e-9d76-5ac0d1b89316</volume>
May 14 04:39:04.625337 np0000000747 nova-compute[97971]:   </usage>
May 14 04:39:04.625337 np0000000747 nova-compute[97971]: </secret>
May 14 04:39:04.625337 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:39:04.631074 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:04.870294 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Took 1.39 seconds to destroy the instance on the hypervisor.
May 14 04:39:04.870952 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:39:04.871164 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:39:04.871257 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:39:04.871816 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:04.967288 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:05.133986 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Attempting to attach volume 5b495c6e-05af-4a2e-9d76-5ac0d1b89316 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:39:05.135282 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <alias name="ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316"/>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <serial>5b495c6e-05af-4a2e-9d76-5ac0d1b89316</serial>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="fc1f4168-96db-4cd7-8ba5-c6331d9c95af"/>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:05.135282 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] Acquiring lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] No waiting events found dispatching network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-unplugged-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Received event network-vif-deleted-0ecbd71b-c99c-4a79-ac7a-2c1215782bd6 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Neutron deleted interface 0ecbd71b-c99c-4a79-ac7a-2c1215782bd6; detaching it from the instance and deleting it from the info cache
May 14 04:39:05.758244 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:05.840433 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:06.262039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-24be5bf1-11a3-4af2-8303-9536c0a94efa req-7e59d260-fdbf-49b0-a0ea-e69e20fa2e10 service nova] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Detach interface failed, port_id=0ecbd71b-c99c-4a79-ac7a-2c1215782bd6, reason: Instance e0dfd328-2cf0-4e24-b9b2-6860817d4537 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:39:06.339179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:06.343177 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Took 1.47 seconds to deallocate network for instance.
May 14 04:39:06.850661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:06.852289 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:07.091429 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:07.091429 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:07.317108 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:07.592990 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:07.761834 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:07.761834 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:07.762026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:07.762026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:af:9e:7c, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:08.102557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:08.171697 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Deleted allocations for instance e0dfd328-2cf0-4e24-b9b2-6860817d4537
May 14 04:39:09.083247 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:09.181836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0d894932-4462-4b07-b6d8-5c755ef61048 tempest-AttachVolumeTestJSON-948226058 tempest-AttachVolumeTestJSON-948226058-project-member] Lock "e0dfd328-2cf0-4e24-b9b2-6860817d4537" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.207s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:09.323250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-37ce9041-98d1-4766-be0d-e228316c13e4 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.314s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:09.360081 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:10.077574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:10.077778 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:10.579998 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Detaching volume 5b495c6e-05af-4a2e-9d76-5ac0d1b89316
May 14 04:39:10.627831 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Attempting to driver detach volume 5b495c6e-05af-4a2e-9d76-5ac0d1b89316 from mountpoint /dev/vdb
May 14 04:39:10.667593 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '41d002ce-8b67-4716-ad8c-950e02e6fa43', 'attached_at': '', 'detached_at': '', 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'serial': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:39:10.672362 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:39:10.673400 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:39:10.673521 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Attempting to detach device vdb from instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:39:10.673769 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <alias name="ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <serial>5b495c6e-05af-4a2e-9d76-5ac0d1b89316</serial>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="fc1f4168-96db-4cd7-8ba5-c6331d9c95af"/>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:10.673769 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:39:10.680608 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 from the persistent domain config.
May 14 04:39:10.680847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] (1/8): Attempting to detach device vdb with device alias ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 from instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:39:10.681241 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <alias name="ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <serial>5b495c6e-05af-4a2e-9d76-5ac0d1b89316</serial>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="fc1f4168-96db-4cd7-8ba5-c6331d9c95af"/>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:10.681241 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:39:11.170538 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733551.1701896, 41d002ce-8b67-4716-ad8c-950e02e6fa43 => ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:39:11.172334 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 for instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:39:11.175123 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 from the live domain config.
May 14 04:39:11.177786 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:39:11.178124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:11.178477 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:11.179024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:11.179466 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:39:11.179717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:11.213012 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '157')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '155')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316', '156')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e2020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:39:11.213012 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flush multipath device 33000000093c9dd62 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:39:11.242919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:11.296405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:11.338236 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:11.339570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:39:11.340573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:39:11.340902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:39:11.351688 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:39:11.352025 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:39:11.364013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.392106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.40.100,3260]
May 14 04:39:11.392106 np0000000747 nova-compute[97971]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.40.100,3260] successful.
May 14 04:39:11.392106 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.408776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.420087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.451525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.50.100,3260]
May 14 04:39:11.451525 np0000000747 nova-compute[97971]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-5b495c6e-05af-4a2e-9d76-5ac0d1b89316, portal: 192.168.50.100,3260] successful.
May 14 04:39:11.451525 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.467985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:11.473132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:11.473132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== disconnect_volume: return (292ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:11.473132 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:39:11.850984 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00039500800039604655 future=<Future at 0x7435f82199d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:11.851529 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733536.8504815, 87bad06f-f93f-449d-b7f3-adeb4a1767ee => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:11.851714 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:11.852036 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] VM Stopped (Lifecycle Event)
May 14 04:39:11.852887 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.981855194999753 future=<Future at 0x7435f8312480 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:11.853114 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=6.981607464999797 future=<Future at 0x7435f8312480 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:12.015229 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:12.354723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 87bad06f-f93f-449d-b7f3-adeb4a1767ee] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:13.022281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-924ad2a2-0b0b-40c5-a864-cba3e7b21a37 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.944s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:13.368041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:13.368101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:13.368226 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:13.368365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:13.368488 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:13.370347 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Terminating instance
May 14 04:39:13.873400 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:39:13.891703 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:13.896335 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:13.915048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:13.919760 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:13.945056 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:13.950185 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.165549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:14.167378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:14.167378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:14.167378 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:14.167378 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] No waiting events found dispatching network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:14.167378 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-39b7658d-f5fe-426c-bbe8-e3d5ba030417 req-e6f12f2e-c567-42ee-8276-ce7171434cb9 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:14.239861 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999615737000113 future=<Future at 0x7435f853f530 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:14.243301 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Instance destroyed successfully.
May 14 04:39:14.243843 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'resources' on Instance uuid 41d002ce-8b67-4716-ad8c-950e02e6fa43 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:14.362888 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.746852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1742298449',display_name='tempest-TestEncryptedCinderVolumes-server-1742298449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1742298449',id=61,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgCCBWwX23WgNFDNS8sXPutG70KTEujtbLKAtXOvNVRkKpv7eiDCQTMpqQxz6Gau5C8KtCcvjKI6wiDWu5kQ0d6shK+SXLwe6nrAV5KYIoSEBA0TUUhst5TMRbMq3pe6w==',key_name='tempest-keypair-1784658885',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:38:22Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-yntgrgx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=41d002ce-8b67-4716-ad8c-950e02e6fa43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:39:14.747035 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "address": "fa:16:3e:af:9e:7c", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9361e2-6f", "ovs_interfaceid": "ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:14.747578 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:14.747789 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:39:14.749180 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.750228 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce9361e2-6f, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:14.751813 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.752841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:14.825791 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.826694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.826890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1f0952c-55d3-4eff-8a16-989b7ce50089) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:14.827690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:14.828630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:14.832670 np0000000747 nova-compute[97971]: INFO os_vif [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9e:7c,bridge_name='br-int',has_traffic_filtering=True,id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9361e2-6f')
May 14 04:39:14.832934 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Deleting instance files /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43_del
May 14 04:39:14.834391 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Deletion of /opt/stack/data/nova/instances/41d002ce-8b67-4716-ad8c-950e02e6fa43_del complete
May 14 04:39:15.346672 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Took 1.47 seconds to destroy the instance on the hypervisor.
May 14 04:39:15.348047 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:39:15.348418 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:39:15.348597 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:39:15.348856 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:15.452954 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:15.480872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:15.481058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:15.963473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1b5761cf-ee0a-4f77-965b-4bc73a8ae559 req-f0e59aa9-1f8c-4632-898a-b52be78a1bda service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-deleted-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:15.965414 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-1b5761cf-ee0a-4f77-965b-4bc73a8ae559 req-f0e59aa9-1f8c-4632-898a-b52be78a1bda service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Neutron deleted interface ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae; detaching it from the instance and deleting it from the info cache
May 14 04:39:15.965590 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1b5761cf-ee0a-4f77-965b-4bc73a8ae559 req-f0e59aa9-1f8c-4632-898a-b52be78a1bda service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:15.983025 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:39:16.185437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:16.185655 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:16.185897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:16.186063 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:16.186215 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:16.189655 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Terminating instance
May 14 04:39:16.231051 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:16.231482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] Acquiring lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:16.231711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:16.232153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:16.232314 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] No waiting events found dispatching network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:16.232490 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-de580a16-8937-4ba3-9325-fe4610f2841b req-33972463-422c-418a-85ee-4399e6db3e30 service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Received event network-vif-unplugged-ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:16.347268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:16.412460 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:16.469398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1b5761cf-ee0a-4f77-965b-4bc73a8ae559 req-f0e59aa9-1f8c-4632-898a-b52be78a1bda service nova] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Detach interface failed, port_id=ce9361e2-6f24-4cb8-81c3-f5fdadefd3ae, reason: Instance 41d002ce-8b67-4716-ad8c-950e02e6fa43 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:39:16.533672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:16.533820 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:16.536659 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:39:16.536805 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Claim successful on node np0000000747
May 14 04:39:16.694175 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:39:16.717525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:16.739076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:16.873259 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:16.879927 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:16.916415 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Took 1.57 seconds to deallocate network for instance.
May 14 04:39:16.934658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:16.934818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:16.934966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:16.935076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:16.935182 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] No waiting events found dispatching network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:16.935287 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b05dc38-0ecd-4a77-94e2-88ad6c8b9071 req-ca5213f8-823d-42f4-9615-39a4da2afeae service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:17.055602 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999669798000014 future=<Future at 0x74361825ec90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:17.061676 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Instance destroyed successfully.
May 14 04:39:17.063298 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:17.424073 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:17.566704 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1967685026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-image-snapshot-server-1967685026',id=62,image_ref='efef8077-da78-4d89-8170-c5e1b226550c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuuGdcGB3451wfzyfLppC2Rlvmr3SP/8qd6ZErrPo0cyrnEITs3l36UrZrq0slLo8KfsOrzhyyMUPsldo/PkOTgC80HFobBkgr3Fa0NuPhHElLIhZDO9hZVdgcKbevLnw==',key_name='tempest-keypair-1639936117',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:38:37Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-2fke738g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-948121274',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=194ac0aa-d0dc-44cd-90b9-3e940f75fa15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:39:17.566704 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "address": "fa:16:3e:ca:e3:00", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdf3f9ae-9f", "ovs_interfaceid": "cdf3f9ae-9f2a-422b-ac00-c75985111df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:17.567211 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:17.567496 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:39:17.568427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:17.568689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdf3f9ae-9f, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:17.581037 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:17.582357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:17.583010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:17.583225 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49c2b3d5-2fd2-4cc2-8e28-94efdb8d2292) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:17.583827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:17.584411 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:17.584622 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:17.587988 np0000000747 nova-compute[97971]: INFO os_vif [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cdf3f9ae-9f2a-422b-ac00-c75985111df3,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdf3f9ae-9f')
May 14 04:39:17.590466 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:39:17.591514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:17.591669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:17.592453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:17.592745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:39:17.595132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:39:17.618583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:17.618583 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:17.618583 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:17.618583 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:17.618583 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:17.618583 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7 (non-flash)
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:17.618950 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:17.618950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49', '158')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:39:17.619204 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '147')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:17.619987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7', '146')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:17.620631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e19e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:39:17.620819 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:39:17.621039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 3300000009dcd11fc {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:39:17.668376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:17.716306 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:17.753162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:39:17.753327 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:39:17.754168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:39:17.766029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:39:17.767386 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:39:17.778006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.809408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.40.100,3260]
May 14 04:39:17.809408 np0000000747 nova-compute[97971]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.40.100,3260] successful.
May 14 04:39:17.809408 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.827950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.860990 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:17.861540 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:17.863202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.899631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.50.100,3260]
May 14 04:39:17.899631 np0000000747 nova-compute[97971]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-ffa5538a-4970-4eda-8fad-3c2dc93db6a7, portal: 192.168.50.100,3260] successful.
May 14 04:39:17.899631 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.914406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:17.914656 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:17.914791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (323ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:17.914964 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:39:17.915305 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Deleting instance files /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15_del
May 14 04:39:17.915976 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Deletion of /opt/stack/data/nova/instances/194ac0aa-d0dc-44cd-90b9-3e940f75fa15_del complete
May 14 04:39:18.367395 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:18.425874 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Took 1.73 seconds to destroy the instance on the hypervisor.
May 14 04:39:18.427172 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:39:18.427430 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:39:18.427530 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:39:18.427820 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:18.522585 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:18.753397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:18.753858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:18.835080 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003160370001751289 future=<Future at 0x7435f8312480 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:18.835411 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Emitting event <LifecycleEvent: 1778733543.8346586, e0dfd328-2cf0-4e24-b9b2-6860817d4537 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:18.835531 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] VM Stopped (Lifecycle Event)
May 14 04:39:18.836242 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:18.836537 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.40289841699996 future=<Future at 0x7435f853f530 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:18.836537 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.402814691999993 future=<Future at 0x7435f853f530 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:18.877849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:18.878066 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:39:18.883134 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.454s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:18.941443 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df448a7e-db4e-4463-b3db-b053fe3b42a6 req-a47cdef2-d52d-43d1-afd0-60edf1520f42 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-deleted-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:18.941590 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-df448a7e-db4e-4463-b3db-b053fe3b42a6 req-a47cdef2-d52d-43d1-afd0-60edf1520f42 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Neutron deleted interface cdf3f9ae-9f2a-422b-ac00-c75985111df3; detaching it from the instance and deleting it from the info cache
May 14 04:39:18.941743 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-df448a7e-db4e-4463-b3db-b053fe3b42a6 req-a47cdef2-d52d-43d1-afd0-60edf1520f42 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:19.003696 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:19.004557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] Acquiring lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:19.004745 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:19.004891 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:19.005037 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] No waiting events found dispatching network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:19.005164 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f5736ba-ea4b-431f-80df-32dfac3fdb46 req-ff1dc09a-68cb-4b47-99e9-58a4ea659054 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Received event network-vif-unplugged-cdf3f9ae-9f2a-422b-ac00-c75985111df3 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:19.157657 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:19.157871 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:19.257411 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'flavor' on Instance uuid 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:19.337881 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: e0dfd328-2cf0-4e24-b9b2-6860817d4537] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:19.389809 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:39:19.390052 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:39:19.390331 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:19.390564 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:19.396799 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:19.445010 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df448a7e-db4e-4463-b3db-b053fe3b42a6 req-a47cdef2-d52d-43d1-afd0-60edf1520f42 service nova] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Detach interface failed, port_id=cdf3f9ae-9f2a-422b-ac00-c75985111df3, reason: Instance 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:39:19.469385 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ce4115c2fe34d3e82ae52dbbfde9b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6190b2a5786942c38225440f6b1f987b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:39:19.610542 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:19.612229 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:19.659969 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:19.891842 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:39:19.899186 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Took 1.47 seconds to deallocate network for instance.
May 14 04:39:19.939074 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Successfully created port: 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:39:20.166025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.288s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:20.223272 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deleted allocations for instance 41d002ce-8b67-4716-ad8c-950e02e6fa43
May 14 04:39:20.262733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:20.398903 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:39:20.454866 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Took 0.55 seconds to detach 1 volumes for instance.
May 14 04:39:20.455281 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Deleting volume: ffa5538a-4970-4eda-8fad-3c2dc93db6a7 {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:39:20.475332 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Successfully updated port: 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:39:20.590124 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:20.591672 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing instance network info cache due to event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:20.591672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:20.591672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:20.591672 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:20.603044 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:20.603282 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:20.905876 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Booting with volume 6c1536ac-d334-4e6b-afda-d3fb026a3142 at /dev/vda
May 14 04:39:20.942992 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:20.956108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:39:20.978152 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:20.996966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:21.020879 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:21.021228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:21.035207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:39:21.035497 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:39:21.045043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:39:21.048674 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fed0:112b', 'fe80::b038:ddff:fe7e:750d'] 
May 14 04:39:21.048859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:39:21.049038 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:39:21.049346 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:21.049636 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating existing volume attachment record: 58857932-6f1c-42fc-b856-8cbeca94232f {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:39:21.092909 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:21.164591 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:21.238727 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7d911148-bfd6-4cd8-a96d-b2cff3a74b52 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "41d002ce-8b67-4716-ad8c-950e02e6fa43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.870s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:21.292898 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:21.293130 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:21.323661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:21.323823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:21.324588 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Attaching volume 74ffd927-9ff9-4c6c-ad2f-33268b57a64a to /dev/vdb
May 14 04:39:21.349435 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:21.355364 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:21.370830 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:21.384364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:39:21.408392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:21.465009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:39:21.465485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:39:21.476276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:39:21.477455 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe1e:8dd5', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fed0:112b', 'fe80::b038:ddff:fe7e:750d'] 
May 14 04:39:21.477572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:39:21.478141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:39:21.478445 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:21.479464 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating existing volume attachment record: e45729ae-a730-42b9-8214-9a393ccda584 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:39:21.609902 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:21.610364 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:21.797123 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:21.857524 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1059bf20-6221-4b44-8419-5db524bec5e2 req-558062bf-9e1e-4228-931f-b2e0e0fe4a64 service nova] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:21.858127 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:21.858348 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:39:22.048392 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7908a07e-77be-4c7c-89f9-3a5247e79251', 'attached_at': '', 'detached_at': '', 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'serial': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:39:22.051101 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:39:22.051455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:22.051580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:22.052154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:22.052324 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:39:22.063786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:22.064280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:22.064873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:22.065119 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:22.065459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:22.065698 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:22.076637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:22.076637 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:22.080209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:22.080209 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:22.086296 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a] added
May 14 04:39:22.086296 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:22.086296 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:22.086296 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:22.086296 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:22.086296 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:22.086296 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:22.086677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:22.086729 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:22.086878 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:22.089921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a] added
May 14 04:39:22.089921 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:22.089921 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:22.089921 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:22.089921 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:22.089921 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:22.089921 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:22.090298 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:22.090298 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:22.090398 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:22.304847 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.284s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:22.370245 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 194ac0aa-d0dc-44cd-90b9-3e940f75fa15
May 14 04:39:22.422867 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:22.594252 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:22.609035 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:22.612907 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:22.769057 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:23.087343 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:23.091989 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:23.099213 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:23.099213 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:23.104020 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:23.104020 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.117135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:23.117448 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:23.117764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.117951 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:23.118110 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:39:23.119244 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.132927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.132927 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.132927 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.132927 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:23.133232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.133232 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.133232 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.133232 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:23.139936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.139936 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.139936 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.139936 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:23.140144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.140144 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.140144 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.140144 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:23.142801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:39:23.145502 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:39:23.145900 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Creating image(s)
May 14 04:39:23.146258 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:39:23.146390 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Ensure instance console log exists: /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:39:23.146587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:23.146765 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:23.146878 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:23.171222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.40.100,3260]
May 14 04:39:23.171222 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.40.100,3260] successful.
May 14 04:39:23.171222 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.178965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.50.100,3260]
May 14 04:39:23.178965 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.50.100,3260] successful.
May 14 04:39:23.178965 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.183264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.190013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:23.199836 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.199836 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.199836 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.199836 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.199836 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.199836 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:23.200055 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.200055 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.200055 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.200055 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.200055 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.200055 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:23.200276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:23.200437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:23.201553 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('7', '-', '-', 0) found on session 159 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:23.201725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:23.208082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.208082 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.208082 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.208082 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.208082 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.208082 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:23.208253 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.208253 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:23.208253 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:23.208253 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.208253 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:23.208253 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:23.208472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:23.208666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:23.209169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('8', '-', '-', 0) found on session 160 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:23.209262 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:23.220882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 159 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:23.220882 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:23.228512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 160 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:23.228512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:23.272296 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:23.272296 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance network_info: |[{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:39:23.273091 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Start _get_guest_xml network_info=[{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '58857932-6f1c-42fc-b856-8cbeca94232f', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '10eb51fd-85a4-4dd3-847e-6c2af4643e9e', 'attached_at': '', 'detached_at': '', 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'serial': '6c1536ac-d334-4e6b-afda-d3fb026a3142'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:39:23.275659 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:39:23.276916 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-139395108', uuid='10eb51fd-85a4-4dd3-847e-6c2af4643e9e'), owner=OwnerMeta(userid='5ce4115c2fe34d3e82ae52dbbfde9b77', username='tempest-TestVolumeBackupRestore-448826571-project-member', projectid='6190b2a5786942c38225440f6b1f987b', projectname='tempest-TestVolumeBackupRestore-448826571'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733563.276533) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:39:23.278731 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:39:23.278731 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:39:23.279520 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:39:23.279736 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:39:23.281111 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:39:23.281111 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:39:23.281305 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:39:23.281460 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:39:23.281689 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:39:23.281819 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:39:23.281964 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:39:23.282198 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:39:23.282375 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:39:23.282523 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:39:23.282693 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:39:23.282869 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:39:23.293831 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:39:23.294080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:23.294269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:23.382388 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ea419cf8-385c-48ef-8f9d-3d4bc847a5f8 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "194ac0aa-d0dc-44cd-90b9-3e940f75fa15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.197s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:24.065338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:39:24.152970 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:24.253575 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:24.254009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:24.338780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:24.342787 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:39:24.344016 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:39:24.345019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:24.390580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:24.390986 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13229MB free_disk=72.75239944458008GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:39:24.391169 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:24.391474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:25.086063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Found WWN 33000000061d7a449 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:39:25.086063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:25.086595 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.792s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:25.086932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:39:25.087429 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000061d7a449', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000061d7a449'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:25.087582 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000061d7a449', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000061d7a449'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:39:25.094383 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:39:25.094709 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:25.094923 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:39:25.103531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:25.104309 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:25.104685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:25.105666 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:25.105666 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:25.105906 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:25.110386 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:25.110579 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:25.116961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:39:25.116961 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:39:25.116961 np0000000747 nova-compute[97971]:     <volume>74ffd927-9ff9-4c6c-ad2f-33268b57a64a</volume>
May 14 04:39:25.116961 np0000000747 nova-compute[97971]:   </usage>
May 14 04:39:25.116961 np0000000747 nova-compute[97971]: </secret>
May 14 04:39:25.116961 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:39:25.118708 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:25.118708 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:25.124382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:25.124382 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:25.125263 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'flavor' on Instance uuid 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142] added
May 14 04:39:25.132067 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:25.132067 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:25.132067 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:25.132369 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142] added
May 14 04:39:25.138226 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:25.138226 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:25.138226 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:25.442017 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 2129e698-f081-4a1b-ab59-fe36409dfe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:39:25.442160 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 7908a07e-77be-4c7c-89f9-3a5247e79251 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:39:25.442255 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 10eb51fd-85a4-4dd3-847e-6c2af4643e9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:39:25.481815 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:25.481977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:25.482136 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:25.482269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:25.482392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:25.484703 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Terminating instance
May 14 04:39:25.612739 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:39:25.628123 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Attempting to attach volume 74ffd927-9ff9-4c6c-ad2f-33268b57a64a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:39:25.629359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <alias name="ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a"/>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <serial>74ffd927-9ff9-4c6c-ad2f-33268b57a64a</serial>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="999c1a8f-dc25-4a87-9916-5097fae8ceeb"/>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:25.629359 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:39:25.944229 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ace1e2ff-341a-44c8-a71b-872582734777 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 14 04:39:25.944512 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:39:25.944699 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:39:24 up 39 min,  2 users,  load average: 5.14, 6.63, 5.23\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'io_workload': '1', 'num_proj_e4f2a515353b48c6b1a74fd3510fd9ac': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_6190b2a5786942c38225440f6b1f987b': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:39:25.990797 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:39:26.023827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.033336 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.045076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.051267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.081024 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.082764 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.132885 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:26.139547 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:26.159267 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:26.159267 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:26.161903 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:26.161903 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.180361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.188485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:26.192515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.203755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.203755 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.203755 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.203755 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.203755 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.203755 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:26.204061 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.204061 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.204061 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.204061 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.204061 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.204061 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:26.214357 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:26.214357 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:26.217464 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.217464 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.217464 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.217464 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.217464 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.217464 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:26.217681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.217681 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.217681 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.217681 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.217681 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.217681 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:26.238279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.40.100,3260]
May 14 04:39:26.238279 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.40.100,3260] successful.
May 14 04:39:26.238279 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.257176 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:26.258687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.258687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.50.100,3260]
May 14 04:39:26.258687 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.50.100,3260] successful.
May 14 04:39:26.258687 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.259125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:26.259290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:26.259418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:26.259543 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] No waiting events found dispatching network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:26.259676 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43d0e633-f5de-4aee-aad6-8bef83c35d52 req-952283db-a483-4552-b2d7-3fec960408a6 service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.277525 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.277866 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:26.278199 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:26.279041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:26.279294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:26.280468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] HCTL ('12', '-', '-', 0) found on session 161 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:26.280627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.298814 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:26.299011 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:26.299441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:26.302974 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Searching for a device in session 161 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:26.303265 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:26.303594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:26.304602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] HCTL ('13', '-', '-', 0) found on session 162 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:26.304949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:26.324670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Searching for a device in session 162 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:26.325420 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:26.342413 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999021805999746 future=<Future at 0x7435f84b2990 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:26.345787 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Instance destroyed successfully.
May 14 04:39:26.346485 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 2129e698-f081-4a1b-ab59-fe36409dfe71 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:26.720400 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:26.848844 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1740017924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-volume-backed-server-1740017924',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaujoJQmNCT0cYSSVsyJmc6z1NsIUnsOlAUG/a4tm7VueixmNo7Y7ALH2EAP/rmO06qPxaPCOqaFz5mupwp1i1l0EB+pq8FwLyPAI+GQvc9p+PsP4zTO0ohrpPOgHWCoA==',key_name='tempest-keypair-1014158341',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:37:30Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-67lv1rpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=2129e698-f081-4a1b-ab59-fe36409dfe71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:39:26.849035 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "address": "fa:16:3e:1e:8d:d5", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca3b42a-7f", "ovs_interfaceid": "6ca3b42a-7fad-4170-ae34-fd6393c787f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:26.849583 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:26.849906 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:39:26.851475 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.851676 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca3b42a-7f, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:26.853530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.854342 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:26.854543 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.855133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.855263 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb109773-a2bf-441d-9914-35249484f407) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:26.855835 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.856235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:26.856395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:26.857992 np0000000747 nova-compute[97971]: INFO os_vif [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:8d:d5,bridge_name='br-int',has_traffic_filtering=True,id=6ca3b42a-7fad-4170-ae34-fd6393c787f1,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca3b42a-7f')
May 14 04:39:26.859368 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:39:26.859542 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:26.859687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:27.107488 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:39:27.226840 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:39:27.227295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.836s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:27.227364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:27.227782 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:27.232042 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:39:27.232207 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Claim successful on node np0000000747
May 14 04:39:28.122375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Found WWN 330000000cdce7a05 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:39:28.122631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:28.122953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] <== connect_volume: return (4828ms) {'type': 'block', 'scsi_wwn': '330000000cdce7a05', 'path': '/dev/dm-1', 'multipath_id': '330000000cdce7a05'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:28.123071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cdce7a05', 'path': '/dev/dm-1', 'multipath_id': '330000000cdce7a05'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:39:28.123440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.264s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:28.123773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73f5393a-089a-4dbc-8a07-af61b13b4748', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:39:28.123891 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:28.148637 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748 (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49 (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:28.148833 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:28.148833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef71e6ac-b171-4296-80ca-d141bd4deb49', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '162')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:39:28.149003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '134')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:28.149915 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748', '135')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:28.150625 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f85e6700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:39:28.150814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:39:28.150999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 330000000d20de2e3 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:39:28.212251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:28.235475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:28.235851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:28.235851 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:28.235906 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No VIF found with MAC fa:16:3e:d0:11:2b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:28.259489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:28.304855 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:39:28.305007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:39:28.305951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:39:28.319870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:39:28.320077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:39:28.333422 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:28.334557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] Acquiring lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:28.334557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:28.334557 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:28.334557 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] No waiting events found dispatching network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:28.334557 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9b2190e4-cacf-4743-8b25-535d22d52b40 req-50a7f9b3-d790-4551-b73a-973f7eadaebe service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-unplugged-6ca3b42a-7fad-4170-ae34-fd6393c787f1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:28.334958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.369865 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.40.100,3260]
May 14 04:39:28.369865 np0000000747 nova-compute[97971]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.40.100,3260] successful.
May 14 04:39:28.369865 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.385222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.396770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.423531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.50.100,3260]
May 14 04:39:28.423531 np0000000747 nova-compute[97971]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-73f5393a-089a-4dbc-8a07-af61b13b4748, portal: 192.168.50.100,3260] successful.
May 14 04:39:28.423531 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.437756 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:28.437987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:28.438085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (1578ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:28.438223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:39:28.438449 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Deleting instance files /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71_del
May 14 04:39:28.438916 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Deletion of /opt/stack/data/nova/instances/2129e698-f081-4a1b-ab59-fe36409dfe71_del complete
May 14 04:39:28.441422 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:28.441590 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:28.628971 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-139395108',display_name='tempest-TestVolumeBackupRestore-server-139395108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebackuprestore-server-139395108',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMGg6Ux7XhP0XqXf+1UY13AfFB9ge703ph7RQm/PeUObDMaZuzJtqAA7YiVkWOnlzPaJz2vJUY9GKNsQQcEycWgjqose9TarK5Nj6MJqkkHjAfRoh1TMC4T9Csz9bIxRg==',key_name='tempest-TestVolumeBackupRestore-1481943374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6190b2a5786942c38225440f6b1f987b',ramdisk_id='',reservation_id='r-wxcow2qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-448826571',owner_user_name='tempest-TestVolumeBackupRestore-448826571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:20Z,user_data=None,user_id='5ce4115c2fe34d3e82ae52dbbfde9b77',uuid=10eb51fd-85a4-4dd3-847e-6c2af4643e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:39:28.629195 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converting VIF {"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:28.629885 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:28.631083 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lazy-loading 'pci_devices' on Instance uuid 10eb51fd-85a4-4dd3-847e-6c2af4643e9e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:28.944322 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Took 2.95 seconds to destroy the instance on the hypervisor.
May 14 04:39:28.944907 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:39:28.945252 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:39:28.945375 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:39:28.945894 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:28.948063 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:29.008555 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:29.135564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <uuid>10eb51fd-85a4-4dd3-847e-6c2af4643e9e</uuid>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <name>instance-00000040</name>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBackupRestore-server-139395108</nova:name>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:39:23</nova:creationTime>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:user uuid="5ce4115c2fe34d3e82ae52dbbfde9b77">tempest-TestVolumeBackupRestore-448826571-project-member</nova:user>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:project uuid="6190b2a5786942c38225440f6b1f987b">tempest-TestVolumeBackupRestore-448826571</nova:project>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         <nova:port uuid="19ab1834-e1b2-472a-8397-628c8b0cfdbc">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <system>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="serial">10eb51fd-85a4-4dd3-847e-6c2af4643e9e</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="uuid">10eb51fd-85a4-4dd3-847e-6c2af4643e9e</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </system>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <os>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </os>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <features>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </features>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   <devices>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/disk.config"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <alias name="ua-6c1536ac-d334-4e6b-afda-d3fb026a3142"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <serial>6c1536ac-d334-4e6b-afda-d3fb026a3142</serial>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:54:a4:46"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <target dev="tap19ab1834-e1"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </interface>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/console.log" append="off"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </serial>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <video>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </video>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </rng>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:   </devices>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]: </domain>
May 14 04:39:29.135564 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Preparing to wait for external event network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-139395108',display_name='tempest-TestVolumeBackupRestore-server-139395108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebackuprestore-server-139395108',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMGg6Ux7XhP0XqXf+1UY13AfFB9ge703ph7RQm/PeUObDMaZuzJtqAA7YiVkWOnlzPaJz2vJUY9GKNsQQcEycWgjqose9TarK5Nj6MJqkkHjAfRoh1TMC4T9Csz9bIxRg==',key_name='tempest-TestVolumeBackupRestore-1481943374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6190b2a5786942c38225440f6b1f987b',ramdisk_id='',reservation_id='r-wxcow2qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-448826571',owner_user_name='tempest-TestVolumeBackupRestore-448826571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:20Z,user_data=None,user_id='5ce4115c2fe34d3e82ae52dbbfde9b77',uuid=10eb51fd-85a4-4dd3-847e-6c2af4643e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converting VIF {"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:29.137547 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:39:29.137880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.138145 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:29.138402 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:39:29.140255 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.140550 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c9a823c-037e-5b74-a3cb-cc3b8dc7ee1f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:29.141261 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.141784 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:29.142074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.143717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.143859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ab1834-e1, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:29.144136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19ab1834-e1, col_values=(('qos', UUID('89e94cb8-8c66-4ef1-9bee-1f0bcc5164c2')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:29.144296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19ab1834-e1, col_values=(('external_ids', {'iface-id': '19ab1834-e1b2-472a-8397-628c8b0cfdbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:a4:46', 'vm-uuid': '10eb51fd-85a4-4dd3-847e-6c2af4643e9e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:29.145469 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.146039 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:29.149603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:29.150375 np0000000747 nova-compute[97971]: INFO os_vif [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1')
May 14 04:39:29.225074 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:29.225581 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:29.225845 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:29.226009 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:39:29.226588 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.38 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:29.239933 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005384189998949296 future=<Future at 0x7435f853f530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:29.244670 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Emitting event <LifecycleEvent: 1778733554.2392945, 41d002ce-8b67-4716-ad8c-950e02e6fa43 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:29.245772 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:29.245891 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.809241486999781 future=<Future at 0x74361825ec90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:29.245975 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=2.8091469510000024 future=<Future at 0x74361825ec90 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:29.247127 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] VM Stopped (Lifecycle Event)
May 14 04:39:29.374862 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4276626b-5c86-419e-b365-169346a043f8 req-4875a546-f2d0-44f5-8743-102f6f1a6aac service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Received event network-vif-deleted-6ca3b42a-7fad-4170-ae34-fd6393c787f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:29.375236 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-4276626b-5c86-419e-b365-169346a043f8 req-4875a546-f2d0-44f5-8743-102f6f1a6aac service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Neutron deleted interface 6ca3b42a-7fad-4170-ae34-fd6393c787f1; detaching it from the instance and deleting it from the info cache
May 14 04:39:29.375378 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-4276626b-5c86-419e-b365-169346a043f8 req-4875a546-f2d0-44f5-8743-102f6f1a6aac service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:29.457449 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.230s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:29.457851 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:39:29.749679 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 41d002ce-8b67-4716-ad8c-950e02e6fa43] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:29.787559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-54b38947-0777-4ab4-85e3-5c2f0512f7e4 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.464s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:29.828872 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:29.878756 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-4276626b-5c86-419e-b365-169346a043f8 req-4875a546-f2d0-44f5-8743-102f6f1a6aac service nova] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Detach interface failed, port_id=6ca3b42a-7fad-4170-ae34-fd6393c787f1, reason: Instance 2129e698-f081-4a1b-ab59-fe36409dfe71 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:39:29.964434 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:39:29.965172 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:39:29.965550 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:29.965865 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:30.034683 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587fcb0c08cf47d386df9d9c088cb0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e458cafac3d48e99410f3bdfd372b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:39:30.204785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:30.205014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:30.330581 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Took 1.39 seconds to deallocate network for instance.
May 14 04:39:30.442672 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Successfully created port: cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:39:30.468243 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:39:30.611255 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:39:30.611583 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:39:30.665151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:30.665338 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:30.665504 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] No VIF found with MAC fa:16:3e:54:a4:46, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:30.666026 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Using config drive
May 14 04:39:30.707138 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Detaching volume 74ffd927-9ff9-4c6c-ad2f-33268b57a64a
May 14 04:39:30.745240 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Attempting to driver detach volume 74ffd927-9ff9-4c6c-ad2f-33268b57a64a from mountpoint /dev/vdb
May 14 04:39:30.776362 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '7908a07e-77be-4c7c-89f9-3a5247e79251', 'attached_at': '', 'detached_at': '', 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'serial': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:39:30.779517 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Found disk vdb by alias ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:39:30.780709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Found disk vdb by alias ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:39:30.780857 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Attempting to detach device vdb from instance 7908a07e-77be-4c7c-89f9-3a5247e79251 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:39:30.781134 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <alias name="ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <serial>74ffd927-9ff9-4c6c-ad2f-33268b57a64a</serial>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="999c1a8f-dc25-4a87-9916-5097fae8ceeb"/>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:30.781134 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:39:30.786276 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully detached device vdb from instance 7908a07e-77be-4c7c-89f9-3a5247e79251 from the persistent domain config.
May 14 04:39:30.786890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] (1/8): Attempting to detach device vdb with device alias ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a from instance 7908a07e-77be-4c7c-89f9-3a5247e79251 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:39:30.786890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <alias name="ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <serial>74ffd927-9ff9-4c6c-ad2f-33268b57a64a</serial>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="999c1a8f-dc25-4a87-9916-5097fae8ceeb"/>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]: </disk>
May 14 04:39:30.786890 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:39:30.886239 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Successfully updated port: cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:39:30.887815 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:39:30.892441 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Deleting volume: 73f5393a-089a-4dbc-8a07-af61b13b4748 {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:39:30.971729 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:39:30.977927 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-changed-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:30.978035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Refreshing instance network info cache due to event network-changed-cda53c4e-073a-41c8-95f3-cfa84616aa46. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:30.978244 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] Acquiring lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:30.978747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] Acquired lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:30.978747 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Refreshing network info cache for port cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:31.172002 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:31.308035 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Creating config drive at /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/disk.config
May 14 04:39:31.311015 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp47yeb_bt {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:31.331132 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733571.3293173, 7908a07e-77be-4c7c-89f9-3a5247e79251 => ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:39:31.332022 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-74ffd927-9ff9-4c6c-ad2f-33268b57a64a for instance 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:39:31.336713 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully detached device vdb from instance 7908a07e-77be-4c7c-89f9-3a5247e79251 from the live domain config.
May 14 04:39:31.339596 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:39:31.340450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:31.340802 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:31.366533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp47yeb_bt" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:31.389799 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:31.449245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:31.449440 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:31.481711 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:31.537657 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:31.674247 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:31.674642 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:31.681602 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:31.745926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:31.765980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:31.853130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:31.981308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:39:31.982484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:39:31.982722 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Creating image(s)
May 14 04:39:31.983181 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:31.983360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:31.983837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:31.984458 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:39:31.987297 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:39:31.988217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:32.018510 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:32.023062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:32.043859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:32.044461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:32.055708 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004941870001857751 future=<Future at 0x74361825ec90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:32.055831 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:32.055964 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.285420005000105 future=<Future at 0x7435f84b2990 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:32.056056 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.285312233999775 future=<Future at 0x7435f84b2990 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:32.056827 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] Emitting event <LifecycleEvent: 1778733557.0550716, 194ac0aa-d0dc-44cd-90b9-3e940f75fa15 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:32.057048 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] VM Stopped (Lifecycle Event)
May 14 04:39:32.085171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:32.085604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:32.086002 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:32.086448 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:39:32.089159 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:39:32.089925 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:32.178264 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:32.184337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-94bca93f-09ba-4a10-8d0f-c37e23ad2d38 req-b3724047-81a1-4a74-b709-266c2bc34357 service nova] Releasing lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:32.185155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquired lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:32.185260 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:39:32.186600 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:32.187605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:32.240297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk 1073741824" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:32.240695 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:32.240987 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:32.333133 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:32.334206 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:39:32.334596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:32.427999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:32.428460 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Cannot resize image /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:39:32.429073 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:39:32.429232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Ensure instance console log exists: /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:39:32.429529 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:32.429772 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:32.429905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:32.464513 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733572.4641411, 10eb51fd-85a4-4dd3-847e-6c2af4643e9e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:32.464707 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] VM Started (Lifecycle Event)
May 14 04:39:32.565029 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-614fb27f-b380-4752-8e45-439741b94908 tempest-TestInstancesWithCinderVolumes-1242058295 tempest-TestInstancesWithCinderVolumes-1242058295-project-member] [instance: 194ac0aa-d0dc-44cd-90b9-3e940f75fa15] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:32.688120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.239s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:32.756700 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 2129e698-f081-4a1b-ab59-fe36409dfe71
May 14 04:39:32.765382 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:32.804145 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.463s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:32.804504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:39:32.804693 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:32.827219 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:32.827581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '164')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:39:32.827581 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '159')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:32.828291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a', '160')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:39:32.828999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8496d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:39:32.829187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:39:32.829418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flush multipath device 33000000061d7a449 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:39:32.865983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:32.904360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:39:32.909943 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:32.954085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:39:32.954291 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:39:32.955198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:39:32.967949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:32.971632 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:39:32.971861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:39:32.972738 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733572.9725077, 10eb51fd-85a4-4dd3-847e-6c2af4643e9e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:32.972930 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] VM Paused (Lifecycle Event)
May 14 04:39:32.984098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.019973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.40.100,3260]
May 14 04:39:33.019973 np0000000747 nova-compute[97971]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.40.100,3260] successful.
May 14 04:39:33.019973 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.037719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.040230 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating instance_info_cache with network_info: [{"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:33.049634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:33.053632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:33.224941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.225605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.174s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:33.225791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:33.225910 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Processing event network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:39:33.226028 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:33.226163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:33.226269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:33.226390 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:33.226493 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] No waiting events found dispatching network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:33.226623 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-376d4390-e8a0-4522-8463-1356cf01993e req-62eccf21-2d6c-4561-b305-75030edf826a service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received unexpected event network-vif-plugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc for instance with vm_state building and task_state spawning.
May 14 04:39:33.227343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:39:33.230451 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:39:33.234770 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance spawned successfully.
May 14 04:39:33.235028 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:39:33.258636 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.50.100,3260]
May 14 04:39:33.258636 np0000000747 nova-compute[97971]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-74ffd927-9ff9-4c6c-ad2f-33268b57a64a, portal: 192.168.50.100,3260] successful.
May 14 04:39:33.258636 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.279788 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:33.283634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:33.283634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== disconnect_volume: return (1940ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:33.283634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:39:33.477071 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:33.479512 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733573.4792368, 10eb51fd-85a4-4dd3-847e-6c2af4643e9e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:33.479645 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] VM Resumed (Lifecycle Event)
May 14 04:39:33.542678 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Releasing lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:33.542804 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance network_info: |[{"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:39:33.544921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Start _get_guest_xml network_info=[{"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:39:33.548010 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:39:33.549472 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1199266827', uuid='ace1e2ff-341a-44c8-a71b-872582734777'), owner=OwnerMeta(userid='587fcb0c08cf47d386df9d9c088cb0fd', username='tempest-TestEncryptedCinderVolumes-1204475822-project-member', projectid='8e458cafac3d48e99410f3bdfd372b6e', projectname='tempest-TestEncryptedCinderVolumes-1204475822'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733573.548957) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:39:33.551082 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:39:33.551543 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:39:33.552994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:39:33.553251 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:39:33.554756 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:39:33.555208 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:39:33.555557 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:39:33.555726 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:39:33.555910 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:39:33.556495 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:39:33.556791 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:39:33.557014 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:39:33.557178 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:39:33.557385 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:39:33.557543 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:39:33.557742 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:39:33.572544 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1199266827',display_name='tempest-TestEncryptedCinderVolumes-server-1199266827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1199266827',id=65,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTC9d+wcE6wOgnLdeO35oQW4tJ3t/T/bRl0VKZngE+VDekNNk2IYJs4imQWmMWh5FYowqytD6ut70Ts0f3Di5P7ZRic0RcRhXNbT4a/fDkOyEPX2/0ophxQMyxt0+Y3CA==',key_name='tempest-keypair-223776826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-e6ckvu67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=ace1e2ff-341a-44c8-a71b-872582734777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:39:33.572755 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:33.573329 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:33.573883 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'pci_devices' on Instance uuid ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.742640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:33.765100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a45f216c-a107-420d-bb8e-87185ad73708 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "2129e698-f081-4a1b-ab59-fe36409dfe71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:33.825432 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'flavor' on Instance uuid 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:33.981992 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:33.986801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:34.076872 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] End _get_guest_xml xml=<domain type="qemu">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <uuid>ace1e2ff-341a-44c8-a71b-872582734777</uuid>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <name>instance-00000041</name>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1199266827</nova:name>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:39:33</nova:creationTime>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:user uuid="587fcb0c08cf47d386df9d9c088cb0fd">tempest-TestEncryptedCinderVolumes-1204475822-project-member</nova:user>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:project uuid="8e458cafac3d48e99410f3bdfd372b6e">tempest-TestEncryptedCinderVolumes-1204475822</nova:project>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         <nova:port uuid="cda53c4e-073a-41c8-95f3-cfa84616aa46">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <system>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="serial">ace1e2ff-341a-44c8-a71b-872582734777</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="uuid">ace1e2ff-341a-44c8-a71b-872582734777</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </system>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <os>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </os>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <features>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </features>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   <devices>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.config"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:fe:5d:22"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <target dev="tapcda53c4e-07"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </interface>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/console.log" append="off"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </serial>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <video>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </video>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </rng>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:   </devices>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]: </domain>
May 14 04:39:34.076872 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Preparing to wait for external event network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1199266827',display_name='tempest-TestEncryptedCinderVolumes-server-1199266827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1199266827',id=65,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTC9d+wcE6wOgnLdeO35oQW4tJ3t/T/bRl0VKZngE+VDekNNk2IYJs4imQWmMWh5FYowqytD6ut70Ts0f3Di5P7ZRic0RcRhXNbT4a/fDkOyEPX2/0ophxQMyxt0+Y3CA==',key_name='tempest-keypair-223776826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-e6ckvu67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=ace1e2ff-341a-44c8-a71b-872582734777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:34.080043 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:39:34.081020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.081020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e38f1b5b-33b2-5fda-8175-0330ba7bba5b', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:34.082100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.082789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:34.088499 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.088742 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcda53c4e-07, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:34.089034 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcda53c4e-07, col_values=(('qos', UUID('30f0885c-3dc8-4e87-b726-d03566d85c0e')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:34.089224 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcda53c4e-07, col_values=(('external_ids', {'iface-id': 'cda53c4e-073a-41c8-95f3-cfa84616aa46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:5d:22', 'vm-uuid': 'ace1e2ff-341a-44c8-a71b-872582734777'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:34.090017 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.091349 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:34.096673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:34.097631 np0000000747 nova-compute[97971]: INFO os_vif [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07')
May 14 04:39:34.250475 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Took 11.11 seconds to spawn the instance on the hypervisor.
May 14 04:39:34.250652 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:34.489796 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:39:34.757998 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Took 18.27 seconds to build instance.
May 14 04:39:34.836733 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f64e0088-6a2a-4b08-ad0a-36a9585cfac0 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.632s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:35.259324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.778s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:35.607312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:35.607865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:35.607865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:35.607965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:35.608218 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:35.610583 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Terminating instance
May 14 04:39:35.613806 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:35.613982 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:35.614103 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:fe:5d:22, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:35.614522 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Using config drive
May 14 04:39:36.113971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:39:36.120480 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:36.152407 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.181930 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.186794 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.225044 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.277107 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Creating config drive at /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.config
May 14 04:39:36.282185 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpespzde6t {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:36.353467 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.365034 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpespzde6t" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:36.426698 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:36.427736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:36.428105 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:36.428377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:36.429324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:36.429713 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b2eb70f6-0691-4710-8cd1-66aa38042eb0 req-ea18dfc3-74b4-4389-9890-88c6072219b6 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:36.452553 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.488101 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.494951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.519729 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.578339 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999630786000125 future=<Future at 0x74361825e390 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:36.583095 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:36.583393 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing instance network info cache due to event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:36.583604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:36.583752 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:36.583935 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:36.588000 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Instance destroyed successfully.
May 14 04:39:36.588424 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'resources' on Instance uuid 7908a07e-77be-4c7c-89f9-3a5247e79251 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:36.831227 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.846347 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.849038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.883974 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.893833 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:36.963929 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.001853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.016174 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.044920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.045520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.090324 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:37.093721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1486398516',display_name='tempest-TestEncryptedCinderVolumes-server-1486398516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1486398516',id=63,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudaeN6/W67H8ZFBaRULkTYJIvFnf7jjJdDQ8gVzcKpLavO7UHlWb3bnZHcGUKq3jI7KgDRbRb442xApAlewORAv0H6N+5Azndq2M5k9Ez0KCGzCZBu2K9bOa0GACi2+w==',key_name='tempest-keypair-1810141524',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:38:40Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-c0zg3qpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaff71e5b25c4613a1f0c37315701570',uuid=7908a07e-77be-4c7c-89f9-3a5247e79251,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:39:37.093947 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "b62e44df-b14a-405b-86c0-b33efc162320", "address": "fa:16:3e:d0:11:2b", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb62e44df-b1", "ovs_interfaceid": "b62e44df-b14a-405b-86c0-b33efc162320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:37.095469 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:37.095469 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:39:37.099046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.100356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.100750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb62e44df-b1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:37.102699 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:37.103879 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.110638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.110638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f2e9999-5765-43fa-8c8d-561612a48882) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:37.110638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.111793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:37.115482 np0000000747 nova-compute[97971]: INFO os_vif [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:11:2b,bridge_name='br-int',has_traffic_filtering=True,id=b62e44df-b14a-405b-86c0-b33efc162320,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb62e44df-b1')
May 14 04:39:37.115862 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Deleting instance files /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251_del
May 14 04:39:37.116805 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Deletion of /opt/stack/data/nova/instances/7908a07e-77be-4c7c-89f9-3a5247e79251_del complete
May 14 04:39:37.357572 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7a919e0c-7762-4552-8480-852a427a73e8 req-b4300407-99dd-4180-aeff-58a6bf3016f8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:37.358422 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a919e0c-7762-4552-8480-852a427a73e8 req-b4300407-99dd-4180-aeff-58a6bf3016f8 service nova] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:37.359152 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a919e0c-7762-4552-8480-852a427a73e8 req-b4300407-99dd-4180-aeff-58a6bf3016f8 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:37.360375 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a919e0c-7762-4552-8480-852a427a73e8 req-b4300407-99dd-4180-aeff-58a6bf3016f8 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:37.360543 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7a919e0c-7762-4552-8480-852a427a73e8 req-b4300407-99dd-4180-aeff-58a6bf3016f8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Processing event network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:39:37.490516 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.502627 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.525739 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:37.627180 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:37.632400 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Took 1.52 seconds to destroy the instance on the hypervisor.
May 14 04:39:37.634973 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:39:37.634973 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:39:37.634973 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:39:37.634973 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:37.712562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:37.712562 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:37.732750 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:37.838121 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updated VIF entry in instance network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:39:37.838538 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:37.959207 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:39:37.960090 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733577.959263, ace1e2ff-341a-44c8-a71b-872582734777 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:37.960200 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] VM Started (Lifecycle Event)
May 14 04:39:37.966128 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:39:37.968818 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance spawned successfully.
May 14 04:39:37.969084 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:39:38.214795 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:39:38.340748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c14ce431-babc-43d9-9c05-1ec85644245f req-ce477a97-aad9-4534-ae3b-c5d04044566f service nova] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:38.468232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:38.481093 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:38.486191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.486191 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.486330 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.487157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.487157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.487157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:38.517131 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.517673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.517854 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.518040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:38.518109 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:38.518170 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:38.518319 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.518437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.518585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.518707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:38.518799 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:38.518900 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received unexpected event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with vm_state active and task_state deleting.
May 14 04:39:38.518986 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.519272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.519272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.519419 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:38.519419 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:38.519529 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received unexpected event network-vif-plugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with vm_state active and task_state deleting.
May 14 04:39:38.519625 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.519767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.519876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.519970 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:38.520060 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:38.520178 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:38.520300 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.520423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Acquiring lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.520592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.520702 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:38.521599 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] No waiting events found dispatching network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:38.521599 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-unplugged-b62e44df-b14a-405b-86c0-b33efc162320 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:39:38.521599 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Received event network-vif-deleted-b62e44df-b14a-405b-86c0-b33efc162320 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:38.521599 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Neutron deleted interface b62e44df-b14a-405b-86c0-b33efc162320; detaching it from the instance and deleting it from the info cache
May 14 04:39:38.521806 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:38.652953 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:38.782137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:38.782355 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:38.785432 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:39:38.785576 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Claim successful on node np0000000747
May 14 04:39:38.985511 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:39:38.986020 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733578.9855196, ace1e2ff-341a-44c8-a71b-872582734777 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:38.986020 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] VM Paused (Lifecycle Event)
May 14 04:39:38.993541 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Took 7.01 seconds to spawn the instance on the hypervisor.
May 14 04:39:38.993697 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:39.026685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0080338e-c719-43cc-8e10-95a46e247150 req-aadfaf72-147d-469b-a5c4-b711911dac87 service nova] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Detach interface failed, port_id=b62e44df-b14a-405b-86c0-b33efc162320, reason: Instance 7908a07e-77be-4c7c-89f9-3a5247e79251 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:39:39.156132 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Took 1.52 seconds to deallocate network for instance.
May 14 04:39:39.437368 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:39.437536 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing instance network info cache due to event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:39.439581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:39.439959 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:39.440133 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:39.488094 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:39.490111 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733579.4899263, ace1e2ff-341a-44c8-a71b-872582734777 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:39.490259 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] VM Resumed (Lifecycle Event)
May 14 04:39:39.501592 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Took 13.38 seconds to build instance.
May 14 04:39:39.661675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:39.920818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:39.921048 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:39.942452 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:39.992180 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:39.994494 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:40.002806 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.892s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:40.107847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:40.108074 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:40.279393 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:40.423061 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:39:40.483726 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updated VIF entry in instance network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:39:40.483726 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:40.612640 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:40.697521 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-changed-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:40.697715 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Refreshing instance network info cache due to event network-changed-cda53c4e-073a-41c8-95f3-cfa84616aa46. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:40.697833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] Acquiring lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:40.697937 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] Acquired lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:40.698077 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Refreshing network info cache for port cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:40.988282 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:40.988517 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:40.988982 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing instance network info cache due to event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:40.988982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:40.989144 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:40.989186 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:40.992971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:41.117555 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.335s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:41.118138 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.456s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:41.120678 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:39:41.200247 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.341932 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005510790001608257 future=<Future at 0x7435f84b2990 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:41.348897 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Emitting event <LifecycleEvent: 1778733566.341266, 2129e698-f081-4a1b-ab59-fe36409dfe71 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:41.349124 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:41.349343 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] VM Stopped (Lifecycle Event)
May 14 04:39:41.349862 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.22808293900016 future=<Future at 0x74361825e390 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:41.350473 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=10.22746295900015 future=<Future at 0x74361825e390 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:41.354591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:41.472075 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:41.472353 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:41.493873 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.566441 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.624069 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:39:41.624268 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:39:41.624451 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.624658 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.734347 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updated VIF entry in instance network info cache for port cda53c4e-073a-41c8-95f3-cfa84616aa46. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:39:41.734635 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating instance_info_cache with network_info: [{"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:41.822316 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50503d1b1ae44e5e8c69903b971f416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7140343d5ce7439ba4f80ea3e535abd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:39:41.852326 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c5fdffc-4ecf-447c-b991-6c2f799c33be tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 2129e698-f081-4a1b-ab59-fe36409dfe71] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:41.910482 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:41.978953 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:42.053785 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updated VIF entry in instance network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:39:42.054134 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:42.111632 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:42.129154 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:39:42.236684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f09513c7-ea3c-4164-b72f-51f468eec8c5 req-ac5b7258-d29b-461f-84b4-5b7c66cd3ba8 service nova] Releasing lock "refresh_cache-ace1e2ff-341a-44c8-a71b-872582734777" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:42.443256 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Successfully created port: 8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:39:42.490778 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.373s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:42.492385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.499s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:42.496038 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:39:42.496211 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Claim successful on node np0000000747
May 14 04:39:42.554732 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deleted allocations for instance 7908a07e-77be-4c7c-89f9-3a5247e79251
May 14 04:39:42.557186 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:42.558184 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:42.558428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:42.558641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:42.558796 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:42.558962 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] No waiting events found dispatching network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:42.559122 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-1715c401-9822-4abe-843c-28c894ad1340 req-96625238-e939-451b-9056-7e47ae903df5 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received unexpected event network-vif-plugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 for instance with vm_state active and task_state None.
May 14 04:39:42.634395 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:39:43.141828 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Booting with volume c6284956-9a84-498c-b69d-3ce7c849e6fb at /dev/vda
May 14 04:39:43.179624 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:43.198165 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:39:43.226145 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:43.280709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:39:43.280924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:39:43.300899 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:39:43.301825 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe54:a446', 'fe80::2073:f1ff:fe73:d83b', 'fe80::fc16:3eff:fefe:5d22', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:39:43.302028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:39:43.302028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:39:43.302307 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:43.302632 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Updating existing volume attachment record: 6254c913-d817-4b46-b976-6f9a79e1c33c {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:39:43.454853 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Successfully updated port: 8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:39:43.511172 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-changed-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:43.513633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Refreshing instance network info cache due to event network-changed-8b2e9494-8d05-4781-8ede-e7026dbadec1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:43.514032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] Acquiring lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:43.514260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] Acquired lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:43.514561 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Refreshing network info cache for port 8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:43.564455 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ddb6f30d-ab57-4ae0-a7c2-4f3bfc1a8829 tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "7908a07e-77be-4c7c-89f9-3a5247e79251" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.957s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:43.772078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:39:43.772357 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:39:43.957631 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:44.020451 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:44.112168 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:44.222100 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:44.276786 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:39:44.723958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5415d984-f599-4dad-9ccb-aef28daacb5b req-40b28c2f-20fc-47de-8652-c86fc52ee44e service nova] Releasing lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:44.724392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquired lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:44.724603 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:39:44.785608 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.295s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:44.786258 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:39:45.293510 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:39:45.293966 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:39:45.293966 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:45.294131 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:45.334836 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:45.364726 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:39:45.413688 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:39:45.414629 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:39:45.414870 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Creating image(s)
May 14 04:39:45.415126 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:39:45.415261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Ensure instance console log exists: /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:39:45.415498 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:45.418525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:45.418672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:45.506170 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:45.649836 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Updating instance_info_cache with network_info: [{"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:45.799464 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:39:45.847716 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Successfully created port: 896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:39:46.152653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Releasing lock "refresh_cache-e4211ed3-dde8-48ec-886d-022daef935e3" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:46.152854 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance network_info: |[{"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:39:46.153666 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Start _get_guest_xml network_info=[{"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6254c913-d817-4b46-b976-6f9a79e1c33c', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e4211ed3-dde8-48ec-886d-022daef935e3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'serial': 'c6284956-9a84-498c-b69d-3ce7c849e6fb'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:39:46.156558 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:39:46.157803 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='e4211ed3-dde8-48ec-886d-022daef935e3'), owner=OwnerMeta(userid='50503d1b1ae44e5e8c69903b971f416a', username='tempest-ImageDependencyTests-1563457996-project-member', projectid='7140343d5ce7439ba4f80ea3e535abd1', projectname='tempest-ImageDependencyTests-1563457996'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733586.1573377) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:39:46.159295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:39:46.159718 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:39:46.160792 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:39:46.161088 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:39:46.161939 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:39:46.162259 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:39:46.162348 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:39:46.162406 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:39:46.162524 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:39:46.162644 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:39:46.162934 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:39:46.163004 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:39:46.163165 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:39:46.163270 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:39:46.163371 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:39:46.163517 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:39:46.174418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:39:46.174813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:46.175038 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:46.175447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:46.175719 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:39:46.226765 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:46.227536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:46.228448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:46.228818 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:46.229378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:46.229681 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:46.250108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:46.250108 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:46.264919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:46.264919 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:46.271250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb] added
May 14 04:39:46.271250 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:46.271250 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:46.271250 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:46.271250 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:46.271250 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:46.271250 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:46.271408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:46.271495 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:46.272643 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:46.275258 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Successfully updated port: 896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:39:46.279986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb] added
May 14 04:39:46.279986 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:46.279986 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:46.279986 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:46.279986 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:46.279986 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:46.279986 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:46.280310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:46.280310 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0515(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:46.280425 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:46.302758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:39:46.341039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-changed-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:46.341222 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Refreshing instance network info cache due to event network-changed-896bc296-0d10-4072-8a23-43d3bf66bcbb. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:46.341664 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] Acquiring lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:46.341782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] Acquired lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:46.342098 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Refreshing network info cache for port 896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:39:46.355824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:46.782129 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:46.808694 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Booting with volume 58342884-b35c-4472-b28e-033d1245564a at /dev/vda
May 14 04:39:46.844148 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:46.848129 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:46.860956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:39:46.899643 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:46.956685 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:46.958919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:39:46.959649 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:39:46.969571 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:39:46.972644 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe54:a446', 'fe80::2073:f1ff:fe73:d83b', 'fe80::fc16:3eff:fefe:5d22', 'fe80::f882:feff:fe18:2ed4'] 
May 14 04:39:46.972644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:39:46.972644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:39:46.972644 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:46.972644 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating existing volume attachment record: 81a38ad7-6e46-477d-b573-5f90e6132015 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:39:47.086062 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:47.113820 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:47.272463 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:47.280938 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:47.287210 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:47.287210 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.302257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:47.324159 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:47.324159 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.332748 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.332748 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.332748 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.332748 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:47.335998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.335998 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.335998 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.335998 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:47.344857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.362108 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.362108 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.362108 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.362108 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:47.363932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.363932 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.363932 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.363932 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:47.379796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.50.100,3260]
May 14 04:39:47.379796 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.50.100,3260] successful.
May 14 04:39:47.379796 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.402798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.403436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.40.100,3260]
May 14 04:39:47.403436 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.40.100,3260] successful.
May 14 04:39:47.403436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.420472 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.420472 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.420472 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.420472 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.420472 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.420472 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:47.420755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.420755 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.420755 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.420755 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.420755 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.420755 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:47.421208 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:47.421397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:47.422256 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] HCTL ('8', '-', '-', 0) found on session 166 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:47.422389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:47.431958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:47.446960 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Searching for a device in session 166 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:47.446960 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:47.448972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.448972 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.448972 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.448972 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.448972 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.448972 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:47.449177 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.449177 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:47.449177 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:47.449177 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.449177 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:47.449177 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:47.449343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:47.449507 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:47.450095 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] HCTL ('9', '-', '-', 0) found on session 167 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:47.450242 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:47.467985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Searching for a device in session 167 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:47.467985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:47.589454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82c3f867-0305-45df-9db6-846d20cf3c4c req-1f73a280-d847-49fe-bf78-97f8a82e3fb6 service nova] Releasing lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:47.590399 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:47.590547 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:39:48.166168 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:39:48.230251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:39:48.337049 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:48.461974 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating instance_info_cache with network_info: [{"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:39:48.964379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:39:48.964803 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance network_info: |[{"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:39:49.085909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:39:49.086973 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:39:49.087220 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Creating image(s)
May 14 04:39:49.087468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:39:49.087582 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Ensure instance console log exists: /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:39:49.087872 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:49.088195 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:49.088339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:49.088798 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Start _get_guest_xml network_info=[{"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '81a38ad7-6e46-477d-b573-5f90e6132015', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd6605193-aad6-4a51-936b-d2713c0b4538', 'attached_at': '', 'detached_at': '', 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'serial': '58342884-b35c-4472-b28e-033d1245564a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:39:49.092800 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:39:49.093902 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1243542656', uuid='d6605193-aad6-4a51-936b-d2713c0b4538'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733589.0935147) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:39:49.095079 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:39:49.095384 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:39:49.096402 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:39:49.096604 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:39:49.097765 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:39:49.098118 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:39:49.098309 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:39:49.098434 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:39:49.098598 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:39:49.098748 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:39:49.098878 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:39:49.099191 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:39:49.099331 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:39:49.099508 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:39:49.099586 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:39:49.099739 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:39:49.113074 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:39:49.113707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:39:49.113825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:49.249243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Found WWN 3300000007dbfe8d4 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:39:49.249682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.074s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:49.250096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] <== connect_volume: return (3075ms) {'type': 'block', 'scsi_wwn': '3300000007dbfe8d4', 'path': '/dev/dm-0', 'multipath_id': '3300000007dbfe8d4'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:49.250271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007dbfe8d4', 'path': '/dev/dm-0', 'multipath_id': '3300000007dbfe8d4'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:39:49.250948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.137s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:49.251272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:39:49.265867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:49.266768 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:39:49.267361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:49.267625 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:49.267949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:39:49.268138 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:49.279799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:49.279799 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:49.284084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:39:49.284084 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:49.291655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a] added
May 14 04:39:49.291655 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:49.291655 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:49.291655 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:49.291655 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:49.291655 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:49.291655 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:49.291955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:49.292030 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:49.292134 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:49.295319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a] added
May 14 04:39:49.295319 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:39:49.295319 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:49.295319 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:49.295319 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:39:49.295319 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:39:49.295319 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:49.295580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:39:49.295580 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:39:49.295711 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:39:49.760513 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='instance-depend-image',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7140343d5ce7439ba4f80ea3e535abd1',ramdisk_id='',reservation_id='r-scm20dqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1563457996',owner_user_name='tempest-ImageDependencyTests-1563457996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:43Z,user_data=None,user_id='50503d1b1ae44e5e8c69903b971f416a',uuid=e4211ed3-dde8-48ec-886d-022daef935e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:39:49.760513 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converting VIF {"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:49.760513 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:49.760513 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lazy-loading 'pci_devices' on Instance uuid e4211ed3-dde8-48ec-886d-022daef935e3 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] End _get_guest_xml xml=<domain type="qemu">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <uuid>e4211ed3-dde8-48ec-886d-022daef935e3</uuid>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <name>instance-00000042</name>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:name>instance-depend-image</nova:name>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:39:46</nova:creationTime>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:properties/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:user uuid="50503d1b1ae44e5e8c69903b971f416a">tempest-ImageDependencyTests-1563457996-project-member</nova:user>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:project uuid="7140343d5ce7439ba4f80ea3e535abd1">tempest-ImageDependencyTests-1563457996</nova:project>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         <nova:port uuid="8b2e9494-8d05-4781-8ede-e7026dbadec1">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="192.168.233.179" ipVersion="4"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <system>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="serial">e4211ed3-dde8-48ec-886d-022daef935e3</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="uuid">e4211ed3-dde8-48ec-886d-022daef935e3</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </system>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <os>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </os>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <features>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </features>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   <devices>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/disk.config"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <alias name="ua-c6284956-9a84-498c-b69d-3ce7c849e6fb"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <serial>c6284956-9a84-498c-b69d-3ce7c849e6fb</serial>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:4d:48:df"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <target dev="tap8b2e9494-8d"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </interface>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/console.log" append="off"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </serial>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <video>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </video>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </rng>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:   </devices>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: </domain>
May 14 04:39:50.264697 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Preparing to wait for external event network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='instance-depend-image',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7140343d5ce7439ba4f80ea3e535abd1',ramdisk_id='',reservation_id='r-scm20dqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1563457996',owner_user_name='tempest-ImageDependencyTests-1563457996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:43Z,user_data=None,user_id='50503d1b1ae44e5e8c69903b971f416a',uuid=e4211ed3-dde8-48ec-886d-022daef935e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:39:50.264697 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converting VIF {"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:50.267434 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:50.267434 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:39:50.267557 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.267736 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:50.268048 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:39:50.268705 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.268839 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '152c96fd-6022-5078-a90d-8c282d43f041', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:50.279868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.280678 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.280942 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:50.281357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.282905 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.283030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b2e9494-8d, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:50.283361 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b2e9494-8d, col_values=(('qos', UUID('d6f1b729-82a5-4d48-a3c0-99f14f2bcf4f')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:50.283506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b2e9494-8d, col_values=(('external_ids', {'iface-id': '8b2e9494-8d05-4781-8ede-e7026dbadec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:48:df', 'vm-uuid': 'e4211ed3-dde8-48ec-886d-022daef935e3'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:50.285388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:50.289021 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:50.290496 np0000000747 nova-compute[97971]: INFO os_vif [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d')
May 14 04:39:50.292396 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:39:50.296933 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:50.306475 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:50.306475 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:39:50.311403 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:39:50.311403 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.319217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.324784 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.332772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.332772 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.332772 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.332772 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.332772 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.332772 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:50.332975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.332975 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.332975 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.332975 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.332975 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.332975 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:50.340562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.340562 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.340562 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.340562 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.340562 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.340562 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:50.340742 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.340742 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.340742 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.340742 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.340742 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.340742 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:50.377641 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260]
May 14 04:39:50.377641 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260] successful.
May 14 04:39:50.377641 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.380949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260]
May 14 04:39:50.380949 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260] successful.
May 14 04:39:50.380949 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.389899 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.395452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.405675 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.407085 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:50.407085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:50.407378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('10', '-', '-', 0) found on session 168 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:50.407510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.412467 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1d1f1-177c-45ba-b228-c133b75e8c8c (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:39:50.413316 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:50.413316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:39:50.414029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('11', '-', '-', 0) found on session 169 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:39:50.414029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:39:50.426333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 168 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:50.426333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:50.433360 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 169 and hctl ['11', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:51.368038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:51.433048 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 169 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:39:51.433203 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:39:51.578306 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00035491600010573165 future=<Future at 0x74361825e390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:51.578905 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Emitting event <LifecycleEvent: 1778733576.5778394, 7908a07e-77be-4c7c-89f9-3a5247e79251 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:51.579045 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] VM Stopped (Lifecycle Event)
May 14 04:39:51.579496 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:39:51.809269 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:51.810923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:51.810923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] No VIF found with MAC fa:16:3e:4d:48:df, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:51.810923 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Using config drive
May 14 04:39:52.081316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: 7908a07e-77be-4c7c-89f9-3a5247e79251] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:52.283377 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 3300000004fed08e9 for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:39:52.283586 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:39:52.283786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3170ms) {'type': 'block', 'scsi_wwn': '3300000004fed08e9', 'path': '/dev/dm-3', 'multipath_id': '3300000004fed08e9'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:39:52.283941 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004fed08e9', 'path': '/dev/dm-3', 'multipath_id': '3300000004fed08e9'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:39:52.315235 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:52.452690 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Creating config drive at /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/disk.config
May 14 04:39:52.456506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpselaq8o6 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:52.508903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpselaq8o6" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:52.789151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1243542656',display_name='tempest-TestVolumeBootPattern-server-1243542656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1243542656',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-fq7y69a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:46Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=d6605193-aad6-4a51-936b-d2713c0b4538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:39:52.789381 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:52.790115 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:52.790958 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid d6605193-aad6-4a51-936b-d2713c0b4538 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:39:52.894373 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:52.956773 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:52.958083 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.012246 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.148012 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-801a282b-662f-490a-9e5d-8880167ff41c req-8356e13f-0d26-449a-b4ef-fbf2bc2a8a59 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:53.148012 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-801a282b-662f-490a-9e5d-8880167ff41c req-8356e13f-0d26-449a-b4ef-fbf2bc2a8a59 service nova] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:53.148243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-801a282b-662f-490a-9e5d-8880167ff41c req-8356e13f-0d26-449a-b4ef-fbf2bc2a8a59 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:53.149138 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-801a282b-662f-490a-9e5d-8880167ff41c req-8356e13f-0d26-449a-b4ef-fbf2bc2a8a59 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:53.149138 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-801a282b-662f-490a-9e5d-8880167ff41c req-8356e13f-0d26-449a-b4ef-fbf2bc2a8a59 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Processing event network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:39:53.199811 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.222749 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.294100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] End _get_guest_xml xml=<domain type="qemu">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <uuid>d6605193-aad6-4a51-936b-d2713c0b4538</uuid>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <name>instance-00000043</name>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-1243542656</nova:name>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:39:49</nova:creationTime>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         <nova:port uuid="896bc296-0d10-4072-8a23-43d3bf66bcbb">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <system>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="serial">d6605193-aad6-4a51-936b-d2713c0b4538</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="uuid">d6605193-aad6-4a51-936b-d2713c0b4538</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </system>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <os>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </os>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <features>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </features>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   <devices>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/disk.config"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <alias name="ua-58342884-b35c-4472-b28e-033d1245564a"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-3"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <serial>58342884-b35c-4472-b28e-033d1245564a</serial>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </disk>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:be:ad:46"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <target dev="tap896bc296-0d"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </interface>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/console.log" append="off"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </serial>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <video>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </video>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </rng>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:   </devices>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]: </domain>
May 14 04:39:53.294100 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Preparing to wait for external event network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1243542656',display_name='tempest-TestVolumeBootPattern-server-1243542656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1243542656',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-fq7y69a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:39:46Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=d6605193-aad6-4a51-936b-d2713c0b4538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:39:53.296444 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:39:53.296778 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.296970 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:53.297076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:39:53.300763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.300939 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e80876b8-7953-5b12-b404-2cc5277ee39c', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:53.302338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.302970 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:53.308853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.309011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896bc296-0d, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:53.309303 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap896bc296-0d, col_values=(('qos', UUID('9cc6c640-9848-49c6-bb5d-70d800696c1c')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:53.309447 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap896bc296-0d, col_values=(('external_ids', {'iface-id': '896bc296-0d10-4072-8a23-43d3bf66bcbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ad:46', 'vm-uuid': 'd6605193-aad6-4a51-936b-d2713c0b4538'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:39:53.313530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:39:53.316632 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:53.317521 np0000000747 nova-compute[97971]: INFO os_vif [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d')
May 14 04:39:53.699645 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733593.6992142, e4211ed3-dde8-48ec-886d-022daef935e3 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:53.700100 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:39:53.700285 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] VM Started (Lifecycle Event)
May 14 04:39:53.702437 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:39:53.705977 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance spawned successfully.
May 14 04:39:53.706217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:39:54.203839 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:54.205627 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:54.211095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.211228 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.211412 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.212976 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.212976 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.212976 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:54.709604 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:39:54.709930 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733594.7097023, e4211ed3-dde8-48ec-886d-022daef935e3 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:54.709930 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] VM Paused (Lifecycle Event)
May 14 04:39:54.715605 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Took 9.30 seconds to spawn the instance on the hypervisor.
May 14 04:39:54.715770 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:54.835008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:54.835156 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:39:54.835268 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:be:ad:46, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:39:54.835683 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Using config drive
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] No waiting events found dispatching network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:55.208435 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d7c4e70f-ce55-473c-853b-c3a57728424c req-b645cd48-36da-4fa0-a61b-c98e88bed467 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received unexpected event network-vif-plugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 for instance with vm_state active and task_state None.
May 14 04:39:55.211906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:55.213718 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733595.213548, e4211ed3-dde8-48ec-886d-022daef935e3 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:55.213826 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] VM Resumed (Lifecycle Event)
May 14 04:39:55.223347 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Took 16.50 seconds to build instance.
May 14 04:39:55.340652 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:39:55.456452 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Creating config drive at /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/disk.config
May 14 04:39:55.459394 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4audx76 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:39:55.520924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4audx76" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:39:55.716298 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:55.720288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:55.726993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.015s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:55.918136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:55.942669 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.054158 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.116020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f46062ad-0762-4c1d-815a-e233251c8f86 req-349af02a-208a-4a05-bf96-c5b8fab42f18 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:56.116713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f46062ad-0762-4c1d-815a-e233251c8f86 req-349af02a-208a-4a05-bf96-c5b8fab42f18 service nova] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:56.117050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f46062ad-0762-4c1d-815a-e233251c8f86 req-349af02a-208a-4a05-bf96-c5b8fab42f18 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:56.117217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f46062ad-0762-4c1d-815a-e233251c8f86 req-349af02a-208a-4a05-bf96-c5b8fab42f18 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:56.117685 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f46062ad-0762-4c1d-815a-e233251c8f86 req-349af02a-208a-4a05-bf96-c5b8fab42f18 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Processing event network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:39:56.198122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.246293 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.248191 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.254045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.254828 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.276808 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.373232 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:56.722009 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:39:56.722543 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733596.7219872, d6605193-aad6-4a51-936b-d2713c0b4538 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:56.722671 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] VM Started (Lifecycle Event)
May 14 04:39:56.730576 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:39:56.735600 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance spawned successfully.
May 14 04:39:56.737238 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:39:57.225169 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:57.229463 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:57.271425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.271425 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.271870 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.272024 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.272310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.272580 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:39:57.734123 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:39:57.734591 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733597.7341213, d6605193-aad6-4a51-936b-d2713c0b4538 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:57.734591 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] VM Paused (Lifecycle Event)
May 14 04:39:57.796885 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Took 8.71 seconds to spawn the instance on the hypervisor.
May 14 04:39:57.797061 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] No waiting events found dispatching network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:39:58.189957 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-fe42087e-5a14-43ec-a707-75d8ec2b21f6 req-b7334196-79e6-4ddf-bea7-802ba149b4f7 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received unexpected event network-vif-plugged-896bc296-0d10-4072-8a23-43d3bf66bcbb for instance with vm_state active and task_state None.
May 14 04:39:58.238726 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:58.239403 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733598.2391477, d6605193-aad6-4a51-936b-d2713c0b4538 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:39:58.239561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] VM Resumed (Lifecycle Event)
May 14 04:39:58.306272 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Took 17.37 seconds to build instance.
May 14 04:39:58.312283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:39:58.743209 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:39:58.747307 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:39:58.808650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8a80b16f-eddd-43d6-b847-5cb118c6453c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.887s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:39:59.587858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-changed-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:39:59.588086 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Refreshing instance network info cache due to event network-changed-896bc296-0d10-4072-8a23-43d3bf66bcbb. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:39:59.588139 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] Acquiring lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:39:59.588235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] Acquired lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:39:59.588357 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Refreshing network info cache for port 896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:40:00.090742 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:00.431141 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:00.587626 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updated VIF entry in instance network info cache for port 896bc296-0d10-4072-8a23-43d3bf66bcbb. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:40:00.590062 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating instance_info_cache with network_info: [{"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:01.085949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:01.088007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:01.088007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:01.088007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:01.088007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:01.089916 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Terminating instance
May 14 04:40:01.095307 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8f9d8fa4-15ca-4dc8-ba53-1194700fd90e req-0471b693-61d9-4769-8250-f1f8c9e29ced service nova] Releasing lock "refresh_cache-d6605193-aad6-4a51-936b-d2713c0b4538" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:01.372207 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.593593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:40:01.616208 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.619841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.641799 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.644979 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.673419 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:01.795642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:01.795642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:01.795642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:01.795642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:01.795642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] No waiting events found dispatching network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:01.799345 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-abac169e-f49f-4d62-a413-e88751b1f8f0 req-8772e7fd-d392-4c8e-9c9b-3c9a2265e152 service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:01.919088 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999625225000273 future=<Future at 0x7436183197f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:01.919385 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999335528000302 future=<Future at 0x7436183197f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:01.919538 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998986581000281 future=<Future at 0x7436183197f0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:01.921419 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Instance destroyed successfully.
May 14 04:40:01.921494 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lazy-loading 'resources' on Instance uuid e4211ed3-dde8-48ec-886d-022daef935e3 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:02.425919 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:39:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='instance-depend-image',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:39:54Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7140343d5ce7439ba4f80ea3e535abd1',ramdisk_id='',reservation_id='r-scm20dqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1563457996',owner_user_name='tempest-ImageDependencyTests-1563457996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:39:55Z,user_data=None,user_id='50503d1b1ae44e5e8c69903b971f416a',uuid=e4211ed3-dde8-48ec-886d-022daef935e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:40:02.426327 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converting VIF {"id": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "address": "fa:16:3e:4d:48:df", "network": {"id": "e6701c07-c772-4d4c-87bd-1b565e499f58", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e7eb0b9d8d84d1f8c1561e0869460a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2e9494-8d", "ovs_interfaceid": "8b2e9494-8d05-4781-8ede-e7026dbadec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:02.426859 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:02.427161 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:40:02.428702 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:02.428909 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b2e9494-8d, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:02.446130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:02.447458 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:02.448803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:02.448977 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6f1b729-82a5-4d48-a3c0-99f14f2bcf4f) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:02.449577 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:02.450912 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:02.452428 np0000000747 nova-compute[97971]: INFO os_vif [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:48:df,bridge_name='br-int',has_traffic_filtering=True,id=8b2e9494-8d05-4781-8ede-e7026dbadec1,network=Network(e6701c07-c772-4d4c-87bd-1b565e499f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2e9494-8d')
May 14 04:40:02.454073 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:40:02.454400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:02.454557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:02.454878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:02.455314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6284956-9a84-498c-b69d-3ce7c849e6fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:40:02.455314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:02.485628 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:02.485980 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:02.485980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100', '172')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:40:02.486356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '167')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:02.487818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb', '166')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:02.488919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618338b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:40:02.489135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Removing multipathed devices sdc, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:40:02.489433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Flush multipath device 3300000007dbfe8d4 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:40:02.536005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:02.596166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:02.644447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:40:02.644604 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:40:02.647368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:40:02.660174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:40:02.660398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:40:02.674685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.709573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.40.100,3260]
May 14 04:40:02.709573 np0000000747 nova-compute[97971]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.40.100,3260] successful.
May 14 04:40:02.709573 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.725710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.737382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.766507 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.50.100,3260]
May 14 04:40:02.766507 np0000000747 nova-compute[97971]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-c6284956-9a84-498c-b69d-3ce7c849e6fb, portal: 192.168.50.100,3260] successful.
May 14 04:40:02.766507 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.787705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:02.787895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:02.787994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] <== disconnect_volume: return (333ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:02.788118 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:40:02.788351 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Deleting instance files /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3_del
May 14 04:40:02.788791 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Deletion of /opt/stack/data/nova/instances/e4211ed3-dde8-48ec-886d-022daef935e3_del complete
May 14 04:40:03.296038 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Took 1.70 seconds to destroy the instance on the hypervisor.
May 14 04:40:03.296812 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:40:03.300636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:40:03.300636 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:40:03.300636 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:03.391276 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:03.887320 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:03.887868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] Acquiring lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:03.887868 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:03.888017 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] Lock "e4211ed3-dde8-48ec-886d-022daef935e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:03.888924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] No waiting events found dispatching network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:03.888924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-unplugged-8b2e9494-8d05-4781-8ede-e7026dbadec1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:03.888924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Received event network-vif-deleted-8b2e9494-8d05-4781-8ede-e7026dbadec1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:03.888924 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Neutron deleted interface 8b2e9494-8d05-4781-8ede-e7026dbadec1; detaching it from the instance and deleting it from the info cache
May 14 04:40:03.888924 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:04.140474 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:04.401648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a33a9f42-6d5a-4553-8a82-1dfc8447420d req-9e56ecd8-e981-4841-83e9-07c3a6718a3f service nova] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Detach interface failed, port_id=8b2e9494-8d05-4781-8ede-e7026dbadec1, reason: Instance e4211ed3-dde8-48ec-886d-022daef935e3 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:40:04.507831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:04.507831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing instance network info cache due to event network-changed-19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:40:04.507831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] Acquiring lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:04.508518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] Acquired lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:04.508518 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Refreshing network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:40:04.643567 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Took 1.35 seconds to deallocate network for instance.
May 14 04:40:05.006922 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:05.007789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:05.008494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:05.009674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:05.009875 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:05.018306 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:05.024429 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Terminating instance
May 14 04:40:05.204230 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:40:05.208532 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Deleting volume: c6284956-9a84-498c-b69d-3ce7c849e6fb {{(pid=97971) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 14 04:40:05.340931 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:05.484225 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updated VIF entry in instance network info cache for port 19ab1834-e1b2-472a-8397-628c8b0cfdbc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:40:05.484850 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [{"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:05.538514 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:40:05.566961 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.589722 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.599169 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.625020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.766360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:05.766596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:05.799398 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:05.799597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:05.799792 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:05.799936 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:05.800146 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] No waiting events found dispatching network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:05.800272 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a44f5eb3-9787-4cb6-b330-5488530a8311 req-509e1815-d747-4dd9-97f8-4dbb261ad724 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:05.873588 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.880938 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:05.897793 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999708058999659 future=<Future at 0x7436183b6f60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:05.902590 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Instance destroyed successfully.
May 14 04:40:05.903210 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lazy-loading 'resources' on Instance uuid 10eb51fd-85a4-4dd3-847e-6c2af4643e9e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:05.987931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b971f481-183e-4c76-94ef-52a5a88a1d5d req-7eae7b2d-8978-4632-8e75-266a50fd22e9 service nova] Releasing lock "refresh_cache-10eb51fd-85a4-4dd3-847e-6c2af4643e9e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:06.052401 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:06.052401 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:06.374823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.406080 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-139395108',display_name='tempest-TestVolumeBackupRestore-server-139395108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebackuprestore-server-139395108',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMGg6Ux7XhP0XqXf+1UY13AfFB9ge703ph7RQm/PeUObDMaZuzJtqAA7YiVkWOnlzPaJz2vJUY9GKNsQQcEycWgjqose9TarK5Nj6MJqkkHjAfRoh1TMC4T9Csz9bIxRg==',key_name='tempest-TestVolumeBackupRestore-1481943374',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:39:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6190b2a5786942c38225440f6b1f987b',ramdisk_id='',reservation_id='r-wxcow2qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-448826571',owner_user_name='tempest-TestVolumeBackupRestore-448826571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:39:34Z,user_data=None,user_id='5ce4115c2fe34d3e82ae52dbbfde9b77',uuid=10eb51fd-85a4-4dd3-847e-6c2af4643e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:40:06.406080 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converting VIF {"id": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "address": "fa:16:3e:54:a4:46", "network": {"id": "73ee03b3-b299-4f3d-883a-38185d10c5a7", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-41213405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6190b2a5786942c38225440f6b1f987b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ab1834-e1", "ovs_interfaceid": "19ab1834-e1b2-472a-8397-628c8b0cfdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:06.406475 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:06.406702 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:40:06.407608 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.407895 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ab1834-e1, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:06.408831 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.409490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:06.409861 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.410479 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.410602 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89e94cb8-8c66-4ef1-9bee-1f0bcc5164c2) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:06.411007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.411427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:06.412278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:06.415610 np0000000747 nova-compute[97971]: INFO os_vif [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a4:46,bridge_name='br-int',has_traffic_filtering=True,id=19ab1834-e1b2-472a-8397-628c8b0cfdbc,network=Network(73ee03b3-b299-4f3d-883a-38185d10c5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ab1834-e1')
May 14 04:40:06.415610 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:40:06.416597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:06.416597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:06.416597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:06.417078 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c1536ac-d334-4e6b-afda-d3fb026a3142', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:40:06.417242 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:40:06.438167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:06.438167 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:06.438167 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:06.438167 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:06.438167 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:06.438167 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:06.438478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:06.438478 np0000000747 nova-compute[97971]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142 (non-flash)
May 14 04:40:06.438478 np0000000747 nova-compute[97971]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:06.438478 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:06.438478 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:06.438478 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:06.438732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100', '172')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:40:06.438732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '161')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:06.439449 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142', '162')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:06.440194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74362d9b3380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:40:06.440400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Removing multipathed devices sdh, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:40:06.440630 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Flush multipath device 330000000cdce7a05 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:40:06.484304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:06.523189 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:06.554552 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:06.562832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:40:06.562994 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:40:06.563855 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:40:06.575016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:40:06.575776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:40:06.594720 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.623833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.40.100,3260]
May 14 04:40:06.623833 np0000000747 nova-compute[97971]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.40.100,3260] successful.
May 14 04:40:06.623833 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.641073 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.656314 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.696319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.50.100,3260]
May 14 04:40:06.696319 np0000000747 nova-compute[97971]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-6c1536ac-d334-4e6b-afda-d3fb026a3142, portal: 192.168.50.100,3260] successful.
May 14 04:40:06.696319 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.711592 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:06.711821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:06.711941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] <== disconnect_volume: return (296ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:06.712071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:40:06.712305 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Deleting instance files /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e_del
May 14 04:40:06.712908 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Deletion of /opt/stack/data/nova/instances/10eb51fd-85a4-4dd3-847e-6c2af4643e9e_del complete
May 14 04:40:06.997379 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:07.001691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:07.062721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.296s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:07.133453 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Deleted allocations for instance e4211ed3-dde8-48ec-886d-022daef935e3
May 14 04:40:07.218649 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Took 1.68 seconds to destroy the instance on the hypervisor.
May 14 04:40:07.219593 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:40:07.219841 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:40:07.219920 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:40:07.220165 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:07.348982 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:07.503221 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:40:07.663286 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1684fb92-4090-4c6b-9eb7-392a2b7f1121 req-31a56482-2c42-44ac-972e-40cf1f56c4db service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-deleted-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:07.663286 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-1684fb92-4090-4c6b-9eb7-392a2b7f1121 req-31a56482-2c42-44ac-972e-40cf1f56c4db service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Neutron deleted interface 19ab1834-e1b2-472a-8397-628c8b0cfdbc; detaching it from the instance and deleting it from the info cache
May 14 04:40:07.663286 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1684fb92-4090-4c6b-9eb7-392a2b7f1121 req-31a56482-2c42-44ac-972e-40cf1f56c4db service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:07.867048 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:07.867456 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] Acquiring lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:07.867646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:07.867761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:07.867869 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] No waiting events found dispatching network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:07.867971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bf17338e-dd38-4d9d-9094-375775cb06f1 req-33df79e8-b7ca-4b34-adf4-9ab37a8c7173 service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Received event network-vif-unplugged-19ab1834-e1b2-472a-8397-628c8b0cfdbc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:08.061971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:08.062178 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:08.067466 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:40:08.068069 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Claim successful on node np0000000747
May 14 04:40:08.116488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:08.143880 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-6956a472-662a-4495-aacf-44f98aec8693 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Lock "e4211ed3-dde8-48ec-886d-022daef935e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.057s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:08.173641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1684fb92-4090-4c6b-9eb7-392a2b7f1121 req-31a56482-2c42-44ac-972e-40cf1f56c4db service nova] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Detach interface failed, port_id=19ab1834-e1b2-472a-8397-628c8b0cfdbc, reason: Instance 10eb51fd-85a4-4dd3-847e-6c2af4643e9e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:40:08.621690 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Took 1.40 seconds to deallocate network for instance.
May 14 04:40:09.178776 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:40:09.341330 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:09.341835 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:09.688938 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:09.846060 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:10.357607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.294s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:10.357607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.668s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:10.357607 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:40:10.640716 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:10.641113 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:10.867595 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:40:10.867853 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:40:10.868157 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:10.870238 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:10.962725 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaff71e5b25c4613a1f0c37315701570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f2a515353b48c6b1a74fd3510fd9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:40:11.143651 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:11.370588 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:40:11.378046 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:11.411868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:11.445255 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Successfully created port: 27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:40:11.652535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.296s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:11.705199 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Deleted allocations for instance 10eb51fd-85a4-4dd3-847e-6c2af4643e9e
May 14 04:40:11.875090 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:40:11.963525 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Successfully updated port: 27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:40:12.025898 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received event network-changed-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:12.026111 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Refreshing instance network info cache due to event network-changed-27326c6b-9e63-4486-ad85-41f172862e28. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:40:12.026284 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] Acquiring lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:12.026387 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] Acquired lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:12.026525 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Refreshing network info cache for port 27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:40:12.379656 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Booting with volume fe236d5e-542f-4c94-9e86-4996f69ee35c at /dev/vda
May 14 04:40:12.419562 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:12.430597 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:40:12.453083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:12.470907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:12.498585 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:40:12.499187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:40:12.509264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:40:12.510192 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fefe:5d22', 'fe80::f882:feff:fe18:2ed4', 'fe80::fc16:3eff:febe:ad46', 'fe80::b8c1:aff:fefc:4b25'] 
May 14 04:40:12.510293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:40:12.510409 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:40:12.510626 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:12.510850 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating existing volume attachment record: 91c0d2eb-b912-4746-b30d-9a49f679678a {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:40:12.530332 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:12.614311 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:40:12.718661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e04032ba-230c-4f6d-98bd-6041a326aafd tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Lock "10eb51fd-85a4-4dd3-847e-6c2af4643e9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.711s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:12.759634 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:13.261538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-84ff9615-c230-469e-9954-8174ca8ee2e0 req-6f55b158-b113-4c39-8043-1bb89802bc05 service nova] Releasing lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:13.264699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquired lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:13.264699 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:40:13.844095 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:40:13.993263 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:14.135285 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating instance_info_cache with network_info: [{"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:14.629101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:40:14.630280 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:40:14.630547 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Creating image(s)
May 14 04:40:14.630921 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:40:14.633012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Ensure instance console log exists: /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:40:14.633304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:14.633535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:14.633688 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:14.637977 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Releasing lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:14.638407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance network_info: |[{"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:40:14.639310 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Start _get_guest_xml network_info=[{"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '91c0d2eb-b912-4746-b30d-9a49f679678a', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'bf06b769-3eb5-4246-8bd8-1f4e9f890dea', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'serial': 'fe236d5e-542f-4c94-9e86-4996f69ee35c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:40:14.646911 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:40:14.648004 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-860741023', uuid='bf06b769-3eb5-4246-8bd8-1f4e9f890dea'), owner=OwnerMeta(userid='aaff71e5b25c4613a1f0c37315701570', username='tempest-TestEncryptedCinderVolumes-100611717-project-member', projectid='e4f2a515353b48c6b1a74fd3510fd9ac', projectname='tempest-TestEncryptedCinderVolumes-100611717'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733614.6477003) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:40:14.649221 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:40:14.649575 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:40:14.650795 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:40:14.651012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:40:14.651881 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:40:14.652216 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:40:14.652385 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:40:14.652513 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:40:14.652687 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:40:14.652805 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:40:14.652940 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:40:14.653135 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:40:14.653312 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:40:14.653462 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:40:14.653621 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:40:14.653786 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:40:14.662746 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:40:14.663104 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:14.663312 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:14.663714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:14.663943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:40:14.678364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:14.678955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:14.679493 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:14.679801 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:14.680224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:14.680468 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:14.693703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:14.693703 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:14.702077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:14.702077 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:14.709282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c] added
May 14 04:40:14.709282 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:14.709282 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:14.709282 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:14.709282 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:14.709282 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:14.709282 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:14.709520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:14.709926 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:14.709926 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:14.715140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c] added
May 14 04:40:14.715140 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:14.715140 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:14.715140 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:14.715140 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:14.715140 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:14.715140 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:14.715389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:14.715498 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:14.715673 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:15.539520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:15.710201 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:15.716151 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:15.726029 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:15.726029 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:15.733687 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:15.733687 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.741845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.747718 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.759137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.759137 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.759137 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.759137 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:15.759338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.759338 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.759338 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.759338 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:15.765767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.765767 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.765767 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.765767 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:15.766032 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.766032 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.766032 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.766032 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:15.792303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.50.100,3260]
May 14 04:40:15.792303 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.50.100,3260] successful.
May 14 04:40:15.792303 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.800592 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.40.100,3260]
May 14 04:40:15.800592 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.40.100,3260] successful.
May 14 04:40:15.800592 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.806019 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.815082 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:15.821524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.821524 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.821524 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.821524 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.821524 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.821524 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:15.821809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.821809 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.821809 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.821809 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.821809 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.821809 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:15.822026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:15.822026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:15.822721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('8', '-', '-', 0) found on session 173 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:15.822847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:15.832047 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:15.832395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:15.832533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:15.833375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('9', '-', '-', 0) found on session 174 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:15.833536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:15.838380 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 173 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:15.838623 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:15.849769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 174 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:15.849769 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:16.379994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:16.412296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:16.679924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:40:16.919018 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00045591699972646893 future=<Future at 0x7436183197f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:16.919148 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:16.919244 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.9782652250000865 future=<Future at 0x7436183b6f60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:16.919324 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=3.978188001000035 future=<Future at 0x7436183b6f60 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:16.919694 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] Emitting event <LifecycleEvent: 1778733601.918434, e4211ed3-dde8-48ec-886d-022daef935e3 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:16.919828 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] VM Stopped (Lifecycle Event)
May 14 04:40:17.035633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:17.035825 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:17.170077 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:17.422351 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-548dadc8-774b-4b52-a69e-6319f6da9123 tempest-TestShelveInstance-710703435 tempest-TestShelveInstance-710703435-project-member] [instance: e4211ed3-dde8-48ec-886d-022daef935e3] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:17.539448 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:17.696038 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Found WWN 3300000002429704f for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:40:17.696504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:17.697189 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000002429704f', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002429704f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:17.697317 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002429704f', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002429704f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:40:17.729394 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'bf06b769-3eb5-4246-8bd8-1f4e9f890dea', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'serial': 'fe236d5e-542f-4c94-9e86-4996f69ee35c'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:40:17.730105 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:40:17.730326 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:17.730506 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:17.745855 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:40:17.745855 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:40:17.745855 np0000000747 nova-compute[97971]:     <volume>fe236d5e-542f-4c94-9e86-4996f69ee35c</volume>
May 14 04:40:17.745855 np0000000747 nova-compute[97971]:   </usage>
May 14 04:40:17.745855 np0000000747 nova-compute[97971]: </secret>
May 14 04:40:17.745855 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:40:18.254230 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-860741023',display_name='tempest-TestEncryptedCinderVolumes-server-860741023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-860741023',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-oapardok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:40:12Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=bf06b769-3eb5-4246-8bd8-1f4e9f890dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:40:18.254541 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:18.255196 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:18.256119 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'pci_devices' on Instance uuid bf06b769-3eb5-4246-8bd8-1f4e9f890dea {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:18.544648 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:18.758446 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] End _get_guest_xml xml=<domain type="qemu">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <uuid>bf06b769-3eb5-4246-8bd8-1f4e9f890dea</uuid>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <name>instance-00000044</name>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-860741023</nova:name>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:40:14</nova:creationTime>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:user uuid="aaff71e5b25c4613a1f0c37315701570">tempest-TestEncryptedCinderVolumes-100611717-project-member</nova:user>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:project uuid="e4f2a515353b48c6b1a74fd3510fd9ac">tempest-TestEncryptedCinderVolumes-100611717</nova:project>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <nova:port uuid="27326c6b-9e63-4486-ad85-41f172862e28">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <system>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="serial">bf06b769-3eb5-4246-8bd8-1f4e9f890dea</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="uuid">bf06b769-3eb5-4246-8bd8-1f4e9f890dea</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </system>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <os>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </os>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <features>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </features>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   <devices>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/disk.config"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </disk>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <alias name="ua-fe236d5e-542f-4c94-9e86-4996f69ee35c"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <serial>fe236d5e-542f-4c94-9e86-4996f69ee35c</serial>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <encryption format="luks">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:         <secret type="passphrase" uuid="4a8528a5-9edb-447a-9e4b-588753343276"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       </encryption>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </disk>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:fc:0a:95"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <target dev="tap27326c6b-9e"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </interface>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/console.log" append="off"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </serial>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <video>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </video>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </rng>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:   </devices>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]: </domain>
May 14 04:40:18.758446 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Preparing to wait for external event network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-860741023',display_name='tempest-TestEncryptedCinderVolumes-server-860741023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-860741023',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-oapardok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:40:12Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=bf06b769-3eb5-4246-8bd8-1f4e9f890dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:40:18.761030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.761382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:18.761438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:40:18.762007 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.762143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '375962d4-c331-58f5-93a4-8f29c181dbb4', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:18.763058 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.763802 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:18.765538 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.765701 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27326c6b-9e, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:18.766021 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27326c6b-9e, col_values=(('qos', UUID('d076f1b1-16b2-4bfa-be21-3e03dede15ea')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:18.766195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27326c6b-9e, col_values=(('external_ids', {'iface-id': '27326c6b-9e63-4486-ad85-41f172862e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:0a:95', 'vm-uuid': 'bf06b769-3eb5-4246-8bd8-1f4e9f890dea'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:18.766923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.768292 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:18.772135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:18.773099 np0000000747 nova-compute[97971]: INFO os_vif [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e')
May 14 04:40:19.594217 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:19.594359 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:19.594593 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Attaching volume 2f6109df-da08-441e-98c7-11e4c481e8d4 to /dev/vdb
May 14 04:40:19.610295 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:19.610862 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:19.634899 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:19.645745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:40:19.666369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:19.709606 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:40:19.710056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:40:19.718397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:40:19.719365 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fefe:5d22', 'fe80::f882:feff:fe18:2ed4', 'fe80::fc16:3eff:febe:ad46', 'fe80::b8c1:aff:fefc:4b25'] 
May 14 04:40:19.719515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:40:19.719677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:40:19.719952 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:19.720336 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating existing volume attachment record: 9a537af9-3270-49b6-b89d-253f13d7c03d {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:40:20.284041 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ace1e2ff-341a-44c8-a71b-872582734777', 'attached_at': '', 'detached_at': '', 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'serial': '2f6109df-da08-441e-98c7-11e4c481e8d4'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:40:20.287081 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:40:20.287488 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:20.287723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:20.288270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:20.288436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:40:20.289642 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:40:20.289808 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:40:20.289971 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No VIF found with MAC fa:16:3e:fc:0a:95, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:40:20.290690 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Using config drive
May 14 04:40:20.301373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:20.302348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:20.302850 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:20.303416 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:20.304168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:20.304168 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:20.314536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:20.314536 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:20.320002 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:20.320002 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:20.327151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4] added
May 14 04:40:20.327151 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:20.327151 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:20.327151 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:20.327151 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:20.327151 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:20.327151 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:20.327326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:20.327516 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:20.327707 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:20.331216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4] added
May 14 04:40:20.331216 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:20.331216 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:20.331216 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:20.331216 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:20.331216 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:20.331216 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:20.331418 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:20.331511 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:20.331608 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:20.602103 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:20.602376 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:20.797382 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:20.898037 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005229530001997773 future=<Future at 0x7436183b6f60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:20.898169 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:20.898675 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Emitting event <LifecycleEvent: 1778733605.8974082, 10eb51fd-85a4-4dd3-847e-6c2af4643e9e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:20.901714 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] VM Stopped (Lifecycle Event)
May 14 04:40:20.916439 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Creating config drive at /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/disk.config
May 14 04:40:20.919743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16lorqlq {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:20.974444 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp16lorqlq" returned: 0 in 0.054s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:40:21.328349 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:21.332029 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:21.342436 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:21.342436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:21.347195 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:21.347195 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.354585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.357831 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.361007 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.372838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.372838 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.372838 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.372838 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.372838 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:21.373353 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.373353 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.373353 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.373353 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.373353 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:21.380198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.380198 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.380198 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.380198 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.380198 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:21.380348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.380348 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.380348 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.380348 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.380348 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:21.386013 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.389537 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.404518 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: 10eb51fd-85a4-4dd3-847e-6c2af4643e9e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:21.412447 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.40.100,3260]
May 14 04:40:21.412447 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.40.100,3260] successful.
May 14 04:40:21.412447 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.417700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.50.100,3260]
May 14 04:40:21.417700 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.50.100,3260] successful.
May 14 04:40:21.417700 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.424481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.432129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.441270 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.442946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('7', '-', '-', 0) found on session 175 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:21.442946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.447761 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:21.447956 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:21.448198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:21.448198 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:21.448858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] HCTL ('12', '-', '-', 0) found on session 176 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:21.448985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:21.475969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.475969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 176 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:21.475969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:21.475969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Searching for a device in session 175 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:21.475969 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:21.535407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-42c2e941-160c-473a-90dc-4be089df76f5 req-21ff4cd1-59ae-4242-a7b1-60558b807f0e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received event network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:21.537001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-42c2e941-160c-473a-90dc-4be089df76f5 req-21ff4cd1-59ae-4242-a7b1-60558b807f0e service nova] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:21.537202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-42c2e941-160c-473a-90dc-4be089df76f5 req-21ff4cd1-59ae-4242-a7b1-60558b807f0e service nova] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:21.537202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-42c2e941-160c-473a-90dc-4be089df76f5 req-21ff4cd1-59ae-4242-a7b1-60558b807f0e service nova] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:21.537351 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-42c2e941-160c-473a-90dc-4be089df76f5 req-21ff4cd1-59ae-4242-a7b1-60558b807f0e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Processing event network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:40:21.685059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.687633 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.689427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:21.710785 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:22.303465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:40:22.845723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:40:22.846740 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733622.846265, bf06b769-3eb5-4246-8bd8-1f4e9f890dea => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:22.846890 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] VM Started (Lifecycle Event)
May 14 04:40:22.848603 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:40:22.854305 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance spawned successfully.
May 14 04:40:22.854639 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:40:23.322318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found WWN 330000000432211d4 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:40:23.322318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:23.323560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000432211d4', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000432211d4'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:23.324560 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000432211d4', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000432211d4'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:40:23.326083 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:40:23.326454 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:23.326786 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:23.327555 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x74363816b4a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'ace1e2ff-341a-44c8-a71b-872582734777', 'attached_at': '', 'detached_at': '', 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'serial': '2f6109df-da08-441e-98c7-11e4c481e8d4'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:40:23.327926 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=97971) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 14 04:40:23.328181 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] opening encrypted volume /dev/dm-1 {{(pid=97971) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 04:40:23.354487 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:23.360347 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:40:23.363339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.363431 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.363874 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.364112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.364418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.364807 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:40:23.373646 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.luks [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 04:40:23.374793 np0000000747 nova-compute[97971]: INFO os_brick.encryptors.luks [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] /dev/dm-1 is not a valid LUKS device; formatting device for first use
May 14 04:40:23.374793 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] formatting encrypted volume /dev/dm-1 {{(pid=97971) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 04:40:23.609875 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:23.610296 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:23.639358 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received event network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:23.639640 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:23.640040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:23.640161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:23.640290 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] No waiting events found dispatching network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:23.640429 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-43b6bc3f-1aaa-456b-a041-26c63248f450 req-0e7ddc0f-9dc6-4649-b422-6c49d22fdce4 service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received unexpected event network-vif-plugged-27326c6b-9e63-4486-ad85-41f172862e28 for instance with vm_state building and task_state spawning.
May 14 04:40:23.768138 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:23.863938 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:40:23.864453 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733623.8640409, bf06b769-3eb5-4246-8bd8-1f4e9f890dea => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:23.864453 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] VM Paused (Lifecycle Event)
May 14 04:40:23.869929 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Took 9.24 seconds to spawn the instance on the hypervisor.
May 14 04:40:23.870126 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:24.115371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:24.115605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:24.115795 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:24.115993 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:40:24.366982 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:24.368901 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733624.3686953, bf06b769-3eb5-4246-8bd8-1f4e9f890dea => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:24.369044 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] VM Resumed (Lifecycle Event)
May 14 04:40:24.384302 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Took 16.38 seconds to build instance.
May 14 04:40:24.871547 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:24.875544 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:40:24.887086 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.886s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:25.148927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:25.250350 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:40:25.255831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:25.367356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:40:25.385907 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:40:25.392418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:40:25.404632 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:40:25.404632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:25.468845 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:40:25.468845 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13260MB free_disk=72.71777725219727GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:40:25.468845 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:25.469059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:25.828503 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received event network-changed-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:25.828503 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Refreshing instance network info cache due to event network-changed-27326c6b-9e63-4486-ad85-41f172862e28. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:40:25.828503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] Acquiring lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:25.828503 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] Acquired lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:25.828503 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Refreshing network info cache for port 27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:40:26.332325 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:26.392565 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:26.570443 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance ace1e2ff-341a-44c8-a71b-872582734777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:40:26.570633 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance d6605193-aad6-4a51-936b-d2713c0b4538 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:40:26.576212 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance bf06b769-3eb5-4246-8bd8-1f4e9f890dea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:40:26.576841 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:40:26.577075 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:40:25 up 40 min,  2 users,  load average: 5.21, 6.49, 5.27\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_8e458cafac3d48e99410f3bdfd372b6e': '1', 'io_workload': '0', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'num_proj_e4f2a515353b48c6b1a74fd3510fd9ac': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:40:26.835239 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:26.835666 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:26.844803 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:26.984655 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updated VIF entry in instance network info cache for port 27326c6b-9e63-4486-ad85-41f172862e28. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:40:26.984655 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating instance_info_cache with network_info: [{"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:27.341802 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:27.487176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f9e4c79f-f9d2-4fdc-91d1-6ae2a60020a7 req-6e9efabb-ede7-41be-a50f-9b72b6c41e8e service nova] Releasing lock "refresh_cache-bf06b769-3eb5-4246-8bd8-1f4e9f890dea" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:27.871668 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:40:27.871779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.403s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:27.872331 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:28.773974 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:29.675421 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] opening encrypted volume /dev/dm-1 {{(pid=97971) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 14 04:40:30.871873 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:30.872310 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:30.872528 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:30.872879 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:30.873077 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:40:30.873505 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.74 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:31.394684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:31.611033 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:40:31.611730 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:31.982166 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:32.485373 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Attempting to attach volume 2f6109df-da08-441e-98c7-11e4c481e8d4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:40:32.487246 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:   <alias name="ua-2f6109df-da08-441e-98c7-11e4c481e8d4"/>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:   <serial>2f6109df-da08-441e-98c7-11e4c481e8d4</serial>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]: </disk>
May 14 04:40:32.487246 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:40:33.775498 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:34.171734 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:40:34.171918 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:40:34.172484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:40:34.172484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] No VIF found with MAC fa:16:3e:fe:5d:22, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:40:35.583933 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:40:35.736193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5db19504-a00b-4c72-9105-3dde8293439b tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.142s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:36.395960 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:36.915637 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:36.916107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:37.054306 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:37.054477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:37.054675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:37.054821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:37.054941 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:37.058260 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Terminating instance
May 14 04:40:37.417893 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Detaching volume 2f6109df-da08-441e-98c7-11e4c481e8d4
May 14 04:40:37.473720 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Attempting to driver detach volume 2f6109df-da08-441e-98c7-11e4c481e8d4 from mountpoint /dev/vdb
May 14 04:40:37.511448 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'ace1e2ff-341a-44c8-a71b-872582734777', 'attached_at': '', 'detached_at': '', 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'serial': '2f6109df-da08-441e-98c7-11e4c481e8d4'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:40:37.522121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-2f6109df-da08-441e-98c7-11e4c481e8d4 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:40:37.522121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Found disk vdb by alias ua-2f6109df-da08-441e-98c7-11e4c481e8d4 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:40:37.522121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Attempting to detach device vdb from instance ace1e2ff-341a-44c8-a71b-872582734777 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:40:37.522121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <alias name="ua-2f6109df-da08-441e-98c7-11e4c481e8d4"/>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <serial>2f6109df-da08-441e-98c7-11e4c481e8d4</serial>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]: </disk>
May 14 04:40:37.522121 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:40:37.531231 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance ace1e2ff-341a-44c8-a71b-872582734777 from the persistent domain config.
May 14 04:40:37.531418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] (1/8): Attempting to detach device vdb with device alias ua-2f6109df-da08-441e-98c7-11e4c481e8d4 from instance ace1e2ff-341a-44c8-a71b-872582734777 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:40:37.531676 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <alias name="ua-2f6109df-da08-441e-98c7-11e4c481e8d4"/>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <serial>2f6109df-da08-441e-98c7-11e4c481e8d4</serial>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]: </disk>
May 14 04:40:37.531676 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:40:37.561315 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:40:37.595675 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:37.597810 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:37.617596 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:37.640561 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:37.642457 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] No waiting events found dispatching network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:37.777392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9897bd27-d26d-4cda-886d-f0d69c09580d req-5d2b9523-3ea3-49db-bdb5-22591d52b716 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:37.887174 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999690976999773 future=<Future at 0x7436183a3ec0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:37.888751 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998047700999905 future=<Future at 0x7436183a3ec0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:37.889014 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997758745999818 future=<Future at 0x7436183a3ec0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:37.891100 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Instance destroyed successfully.
May 14 04:40:37.891540 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid d6605193-aad6-4a51-936b-d2713c0b4538 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:38.070635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733638.0703034, ace1e2ff-341a-44c8-a71b-872582734777 => ua-2f6109df-da08-441e-98c7-11e4c481e8d4> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:40:38.072320 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2f6109df-da08-441e-98c7-11e4c481e8d4 for instance ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:40:38.075076 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully detached device vdb from instance ace1e2ff-341a-44c8-a71b-872582734777 from the live domain config.
May 14 04:40:38.076471 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:40:38.076666 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:38.076842 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:40:38.077528 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x74363529b620>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'ace1e2ff-341a-44c8-a71b-872582734777', 'attached_at': '', 'detached_at': '', 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'serial': '2f6109df-da08-441e-98c7-11e4c481e8d4'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:40:38.077677 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] closing encrypted volume /dev/dm-2 {{(pid=97971) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 14 04:40:38.100858 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:40:38.101159 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:38.101339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:38.395477 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1243542656',display_name='tempest-TestVolumeBootPattern-server-1243542656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-1243542656',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:39:57Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-fq7y69a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:39:58Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=d6605193-aad6-4a51-936b-d2713c0b4538,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:40:38.395907 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "address": "fa:16:3e:be:ad:46", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896bc296-0d", "ovs_interfaceid": "896bc296-0d10-4072-8a23-43d3bf66bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:38.396933 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:38.397272 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:40:38.398913 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.399125 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896bc296-0d, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:38.400138 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.401140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:38.401421 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.402153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.402310 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc6c640-9848-49c6-bb5d-70d800696c1c) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:38.402727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.403307 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:38.403575 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:38.405634 np0000000747 nova-compute[97971]: INFO os_vif [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ad:46,bridge_name='br-int',has_traffic_filtering=True,id=896bc296-0d10-4072-8a23-43d3bf66bcbb,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896bc296-0d')
May 14 04:40:38.407215 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:40:38.407508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:38.407661 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:39.657124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.554s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:39.657124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f6109df-da08-441e-98c7-11e4c481e8d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:40:39.657124 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.682934 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4 (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.683380 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:39.683380 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683', '179')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:40:39.683794 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', '175')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:39.684802 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4', '176')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:39.686667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b6e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:40:39.686944 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Removing multipathed devices sdg, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:40:39.687231 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Flush multipath device 330000000432211d4 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:40:39.718997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:39.769268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:39.817824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if SCSI volumes sdg, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:40:39.818011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] SCSI volumes sdg, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:40:39.819510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Checking to see if device paths {'sdg', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:40:39.831219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:39.831646 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] Acquiring lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:39.831843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:39.831991 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] Lock "d6605193-aad6-4a51-936b-d2713c0b4538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:39.832151 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] No waiting events found dispatching network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:39.832281 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0499f028-2aff-4a10-bfd8-a1e962db49ea req-266b6d3d-2b27-4d66-9834-514c823852b2 service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-unplugged-896bc296-0d10-4072-8a23-43d3bf66bcbb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:39.832919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Device paths {'sdg', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:40:39.833263 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:40:39.845271 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.874776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.40.100,3260]
May 14 04:40:39.874776 np0000000747 nova-compute[97971]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.40.100,3260] successful.
May 14 04:40:39.874776 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.891009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.902537 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.928554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.50.100,3260]
May 14 04:40:39.928554 np0000000747 nova-compute[97971]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-2f6109df-da08-441e-98c7-11e4c481e8d4, portal: 192.168.50.100,3260] successful.
May 14 04:40:39.928554 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.944133 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:39.945071 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:39.945352 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] <== disconnect_volume: return (1843ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:39.945493 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:40:39.947353 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.540s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:39.947833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:40:39.947977 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.974682 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683 (non-flash)
May 14 04:40:39.975081 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '174'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c472b4f2-e636-461b-9291-0e93b7e8d683', '179')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:40:39.975081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '168')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:39.975885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '169')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:40:39.976600 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84b8fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:40:39.976799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sde, sdf {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:40:39.976979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 3300000004fed08e9 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:40:40.044267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:40.083184 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:40:40.123147 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:40:40.123322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sde, sdf have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:40:40.124074 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:40:40.136948 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:40:40.137171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:40:40.151106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.183391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260]
May 14 04:40:40.183391 np0000000747 nova-compute[97971]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260] successful.
May 14 04:40:40.183391 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.197506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.207573 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.234459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260]
May 14 04:40:40.234459 np0000000747 nova-compute[97971]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260] successful.
May 14 04:40:40.234459 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.248343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:40.248563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:40.248728 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (1841ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:40.248900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:40:40.249260 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Deleting instance files /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538_del
May 14 04:40:40.249735 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Deletion of /opt/stack/data/nova/instances/d6605193-aad6-4a51-936b-d2713c0b4538_del complete
May 14 04:40:40.493320 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'flavor' on Instance uuid ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:40.755377 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Took 3.19 seconds to destroy the instance on the hypervisor.
May 14 04:40:40.755983 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:40:40.756399 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:40:40.756492 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:40:40.756969 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:40.815461 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:41.261468 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-304ce029-66d5-41bb-8247-870500272972 req-e03bbf35-4af5-4d3b-8112-d45e44296b4b service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Received event network-vif-deleted-896bc296-0d10-4072-8a23-43d3bf66bcbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:41.261725 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-304ce029-66d5-41bb-8247-870500272972 req-e03bbf35-4af5-4d3b-8112-d45e44296b4b service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Neutron deleted interface 896bc296-0d10-4072-8a23-43d3bf66bcbb; detaching it from the instance and deleting it from the info cache
May 14 04:40:41.262470 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-304ce029-66d5-41bb-8247-870500272972 req-e03bbf35-4af5-4d3b-8112-d45e44296b4b service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:41.396853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:41.498866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c4591603-2de1-4328-be39-de33224cd383 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.583s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:41.694498 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:41.765104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-304ce029-66d5-41bb-8247-870500272972 req-e03bbf35-4af5-4d3b-8112-d45e44296b4b service nova] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Detach interface failed, port_id=896bc296-0d10-4072-8a23-43d3bf66bcbb, reason: Instance d6605193-aad6-4a51-936b-d2713c0b4538 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:40:42.196492 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Took 1.44 seconds to deallocate network for instance.
May 14 04:40:42.258337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:42.258490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:42.258604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:42.258738 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:42.258850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:42.260620 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Terminating instance
May 14 04:40:42.744415 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Took 0.55 seconds to detach 1 volumes for instance.
May 14 04:40:42.762914 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:40:42.778991 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.780825 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.796638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.799306 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.816259 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.822025 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:42.963340 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:42.963756 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:42.963921 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:42.964053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:42.964148 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] No waiting events found dispatching network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:42.964277 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-871ac4a6-1650-4a6e-80bd-307e2ef27cc3 req-0fff56bd-9f10-4948-8fc9-994814f90192 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:43.074380 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999750507000044 future=<Future at 0x7436183b5490 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:43.076021 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Instance destroyed successfully.
May 14 04:40:43.076496 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lazy-loading 'resources' on Instance uuid ace1e2ff-341a-44c8-a71b-872582734777 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:43.249227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:43.249353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:43.403074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.415002 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:43.415202 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:43.578743 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1199266827',display_name='tempest-TestEncryptedCinderVolumes-server-1199266827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-1199266827',id=65,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTC9d+wcE6wOgnLdeO35oQW4tJ3t/T/bRl0VKZngE+VDekNNk2IYJs4imQWmMWh5FYowqytD6ut70Ts0f3Di5P7ZRic0RcRhXNbT4a/fDkOyEPX2/0ophxQMyxt0+Y3CA==',key_name='tempest-keypair-223776826',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:39:38Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e458cafac3d48e99410f3bdfd372b6e',ramdisk_id='',reservation_id='r-e6ckvu67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1204475822',owner_user_name='tempest-TestEncryptedCinderVolumes-1204475822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587fcb0c08cf47d386df9d9c088cb0fd',uuid=ace1e2ff-341a-44c8-a71b-872582734777,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:40:43.578913 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converting VIF {"id": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "address": "fa:16:3e:fe:5d:22", "network": {"id": "f2f452f6-8811-4166-a345-c49ed972bf6c", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1474603260-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8e458cafac3d48e99410f3bdfd372b6e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda53c4e-07", "ovs_interfaceid": "cda53c4e-073a-41c8-95f3-cfa84616aa46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:43.579338 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:43.579531 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:40:43.580434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.580630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcda53c4e-07, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:43.581569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.582529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:43.582855 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.583717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.583717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30f0885c-3dc8-4e87-b726-d03566d85c0e) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:43.584654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:43.584654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:43.586630 np0000000747 nova-compute[97971]: INFO os_vif [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:5d:22,bridge_name='br-int',has_traffic_filtering=True,id=cda53c4e-073a-41c8-95f3-cfa84616aa46,network=Network(f2f452f6-8811-4166-a345-c49ed972bf6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda53c4e-07')
May 14 04:40:43.586630 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Deleting instance files /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777_del
May 14 04:40:43.587355 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Deletion of /opt/stack/data/nova/instances/ace1e2ff-341a-44c8-a71b-872582734777_del complete
May 14 04:40:43.917592 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:44.093317 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Took 1.33 seconds to destroy the instance on the hypervisor.
May 14 04:40:44.093698 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:40:44.093949 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:40:44.094030 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:40:44.094240 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:44.153995 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:44.423472 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.174s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:44.480428 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance d6605193-aad6-4a51-936b-d2713c0b4538
May 14 04:40:44.565249 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fa0fcfb6-c148-4199-9ca3-e6b97d6d8f48 req-571d553d-22bd-44d2-8679-38fe1bfe8d97 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-deleted-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:44.565596 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-fa0fcfb6-c148-4199-9ca3-e6b97d6d8f48 req-571d553d-22bd-44d2-8679-38fe1bfe8d97 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Neutron deleted interface cda53c4e-073a-41c8-95f3-cfa84616aa46; detaching it from the instance and deleting it from the info cache
May 14 04:40:44.565762 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fa0fcfb6-c148-4199-9ca3-e6b97d6d8f48 req-571d553d-22bd-44d2-8679-38fe1bfe8d97 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:45.019355 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:45.027597 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:45.028824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] Acquiring lock "ace1e2ff-341a-44c8-a71b-872582734777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:45.028824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:45.028824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] Lock "ace1e2ff-341a-44c8-a71b-872582734777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:45.028824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] No waiting events found dispatching network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:40:45.028824 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3dfce652-1da4-4585-9182-a988a534db57 req-52a7f108-d716-4961-8e64-c57d2c3d706b service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Received event network-vif-unplugged-cda53c4e-073a-41c8-95f3-cfa84616aa46 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:40:45.069169 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fa0fcfb6-c148-4199-9ca3-e6b97d6d8f48 req-571d553d-22bd-44d2-8679-38fe1bfe8d97 service nova] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Detach interface failed, port_id=cda53c4e-073a-41c8-95f3-cfa84616aa46, reason: Instance ace1e2ff-341a-44c8-a71b-872582734777 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:40:45.488311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-df21aba0-d4a7-411e-85d3-77045052d707 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "d6605193-aad6-4a51-936b-d2713c0b4538" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.434s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:45.524741 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Took 1.43 seconds to deallocate network for instance.
May 14 04:40:46.030691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:46.031045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:46.324750 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:46.325378 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:46.400503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:46.835576 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:47.320837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:47.321780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:47.364671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.334s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:47.409912 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Deleted allocations for instance ace1e2ff-341a-44c8-a71b-872582734777
May 14 04:40:47.825654 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:40:48.383831 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:48.384497 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:48.388536 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:40:48.388710 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Claim successful on node np0000000747
May 14 04:40:48.420111 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f3f4f5e-3f5d-4435-8393-2909faeff9f7 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Lock "ace1e2ff-341a-44c8-a71b-872582734777" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.162s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:48.585356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:49.519471 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:40:49.519828 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:40:50.022034 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:40:50.527718 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:50.528096 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:40:51.033741 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:40:51.033992 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:40:51.034249 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:51.034455 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:51.103038 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:40:51.402860 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:51.539424 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:40:51.551201 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:51.687097 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Successfully created port: 08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:40:52.054890 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:40:52.168183 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Successfully updated port: 08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:40:52.236341 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-changed-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:40:52.236502 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing instance network info cache due to event network-changed-08fab781-26b9-48e2-af73-af5af73d665c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:40:52.237692 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] Acquiring lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:52.239632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] Acquired lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:52.239886 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing network info cache for port 08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:40:52.578499 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Booting with volume 58342884-b35c-4472-b28e-033d1245564a at /dev/vda
May 14 04:40:52.616926 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:52.652798 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:40:52.670504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:40:52.685266 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:40:52.742722 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:52.746210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:40:52.747531 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:40:52.759627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:40:52.760726 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fefc:a95', 'fe80::b038:ddff:fe7e:750d'] 
May 14 04:40:52.760884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:40:52.760949 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:40:52.761151 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:52.761323 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating existing volume attachment record: 110b6723-de8d-415e-9aee-ed7a2fffcc45 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:40:52.819386 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:40:52.887238 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00042651400008253404 future=<Future at 0x7436183a3ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:52.887384 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:52.887480 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.1866964720002215 future=<Future at 0x7436183b5490 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:52.887480 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=5.186626932999843 future=<Future at 0x7436183b5490 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:52.888117 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733637.8867083, d6605193-aad6-4a51-936b-d2713c0b4538 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:52.888374 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] VM Stopped (Lifecycle Event)
May 14 04:40:52.972566 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:53.383595 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:53.392680 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: d6605193-aad6-4a51-936b-d2713c0b4538] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:53.474266 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52ff50a3-c3b9-4e16-9c71-5170bea9f2a8 req-0d156527-df21-42e0-a2d9-846261de8a58 service nova] Releasing lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:53.474715 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:40:53.474934 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:40:53.586023 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:54.048871 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:40:54.197294 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:40:54.360515 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating instance_info_cache with network_info: [{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:40:54.863241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:40:54.863775 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance network_info: |[{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:40:54.882125 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:40:54.883477 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:40:54.883777 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Creating image(s)
May 14 04:40:54.884159 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:40:54.884312 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Ensure instance console log exists: /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:40:54.884551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:54.885471 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:54.885763 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:54.886351 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Start _get_guest_xml network_info=[{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '110b6723-de8d-415e-9aee-ed7a2fffcc45', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dee217de-fe65-44b9-8ef7-685eb8107b32', 'attached_at': '', 'detached_at': '', 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'serial': '58342884-b35c-4472-b28e-033d1245564a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:40:54.889424 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:40:54.890774 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-652886939', uuid='dee217de-fe65-44b9-8ef7-685eb8107b32'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733654.890387) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:40:54.892345 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:40:54.892708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:40:54.893731 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:40:54.893890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:40:54.895004 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:40:54.895270 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:40:54.895447 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:40:54.895490 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:40:54.895566 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:40:54.895696 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:40:54.895779 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:40:54.895915 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:40:54.896009 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:40:54.896120 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:40:54.896217 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:40:54.896327 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:40:54.906084 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:40:54.906364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:40:54.906481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:55.659402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.753s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:55.659585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:40:55.671077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:55.671710 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:40:55.672224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:55.672395 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:55.675261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:40:55.675261 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:55.684451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:55.684451 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:55.691660 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:40:55.691660 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:55.697280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a] added
May 14 04:40:55.697280 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:55.697280 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:55.697280 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:55.697280 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:55.697280 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:55.697280 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:55.697540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:55.697577 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:55.697775 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:55.703689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a] added
May 14 04:40:55.703689 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:40:55.703689 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:55.703689 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:55.703689 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:40:55.703689 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:40:55.703689 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:55.703858 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:40:55.704038 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:40:55.704196 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:40:56.403714 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:56.698291 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:40:56.704694 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:56.711155 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:56.711155 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:40:56.717692 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:40:56.717692 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.723441 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.729555 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.737445 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:56.749034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.749034 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.749034 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.749034 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.749034 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:56.749434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.749434 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.749434 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.749434 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.749434 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:56.784587 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260]
May 14 04:40:56.784587 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260] successful.
May 14 04:40:56.784587 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.799162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.805871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260]
May 14 04:40:56.805871 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260] successful.
May 14 04:40:56.805871 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.816387 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:56.817598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:56.817598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:56.818083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:40:56.819186 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('11', '-', '-', 0) found on session 183 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:56.819451 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.835113 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-825a690d-2ae8-4118-960a-4d98fe1cc2f2 (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a64d0b22-0c3c-4ac9-85e0-68646bfa3100 (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:40:56.835351 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:40:56.835479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:56.835592 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:40:56.836280 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('12', '-', '-', 0) found on session 184 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:40:56.836367 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:40:56.845732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 183 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:56.845732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:56.858904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 184 and hctl ['12', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:57.281069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:57.760328 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:57.859455 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 184 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:40:57.859598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:40:58.074502 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003386349999345839 future=<Future at 0x7436183b5490 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:58.074716 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:40:58.075002 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733643.0740552, ace1e2ff-341a-44c8-a71b-872582734777 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:40:58.075161 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] VM Stopped (Lifecycle Event)
May 14 04:40:58.578457 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a31d3980-f671-4010-9d7b-f232d00190b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: ace1e2ff-341a-44c8-a71b-872582734777] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:40:58.586738 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:58.687540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 3300000004fed08e9 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:40:58.688480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:40:58.688480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3781ms) {'type': 'block', 'scsi_wwn': '3300000004fed08e9', 'path': '/dev/dm-1', 'multipath_id': '3300000004fed08e9'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:40:58.688480 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004fed08e9', 'path': '/dev/dm-1', 'multipath_id': '3300000004fed08e9'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:40:59.064815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.194802 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652886939',display_name='tempest-TestVolumeBootPattern-server-652886939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-652886939',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-k8dcv9cf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:40:52Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=dee217de-fe65-44b9-8ef7-685eb8107b32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:40:59.195741 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:59.195741 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:59.196745 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid dee217de-fe65-44b9-8ef7-685eb8107b32 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:40:59.701977 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] End _get_guest_xml xml=<domain type="qemu">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <uuid>dee217de-fe65-44b9-8ef7-685eb8107b32</uuid>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <name>instance-00000045</name>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-652886939</nova:name>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:40:54</nova:creationTime>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         <nova:port uuid="08fab781-26b9-48e2-af73-af5af73d665c">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <system>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="serial">dee217de-fe65-44b9-8ef7-685eb8107b32</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="uuid">dee217de-fe65-44b9-8ef7-685eb8107b32</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </system>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <os>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </os>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <features>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </features>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   <devices>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/disk.config"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </disk>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <alias name="ua-58342884-b35c-4472-b28e-033d1245564a"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-1"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <serial>58342884-b35c-4472-b28e-033d1245564a</serial>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </disk>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ef:b5:3d"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <target dev="tap08fab781-26"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </interface>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/console.log" append="off"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </serial>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <video>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </video>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </rng>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:   </devices>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]: </domain>
May 14 04:40:59.701977 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Preparing to wait for external event network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652886939',display_name='tempest-TestVolumeBootPattern-server-652886939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-652886939',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-k8dcv9cf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:40:52Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=dee217de-fe65-44b9-8ef7-685eb8107b32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:40:59.704157 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:40:59.704404 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:40:59.704665 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:40:59.705029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.705179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:59.705425 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:40:59.706052 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.706202 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b478494-c074-531c-b471-187be87f215b', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:59.707155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.708296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:59.708296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.711031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.711270 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08fab781-26, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:59.711549 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08fab781-26, col_values=(('qos', UUID('f214b528-08dc-4c42-acab-2cde4ae4f3c7')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:59.711773 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08fab781-26, col_values=(('external_ids', {'iface-id': '08fab781-26b9-48e2-af73-af5af73d665c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:b5:3d', 'vm-uuid': 'dee217de-fe65-44b9-8ef7-685eb8107b32'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:40:59.712858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.714124 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:40:59.719436 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:40:59.720219 np0000000747 nova-compute[97971]: INFO os_vif [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26')
May 14 04:41:01.250503 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:01.251029 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:01.251029 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:ef:b5:3d, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:41:01.251480 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Using config drive
May 14 04:41:01.406259 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:01.628130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:01.758571 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:01.880694 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Creating config drive at /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/disk.config
May 14 04:41:01.886441 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujrn44y0 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:01.943791 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujrn44y0" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:02.409414 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:02.450986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:02.546375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:02.626322 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9e533a6-6b82-4205-b975-6bf6c4ffac07 req-ccefe7ac-d09b-40d1-aac9-85a88580e9e8 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:02.626626 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9e533a6-6b82-4205-b975-6bf6c4ffac07 req-ccefe7ac-d09b-40d1-aac9-85a88580e9e8 service nova] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:02.626829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9e533a6-6b82-4205-b975-6bf6c4ffac07 req-ccefe7ac-d09b-40d1-aac9-85a88580e9e8 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:02.627103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e9e533a6-6b82-4205-b975-6bf6c4ffac07 req-ccefe7ac-d09b-40d1-aac9-85a88580e9e8 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:02.629218 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e9e533a6-6b82-4205-b975-6bf6c4ffac07 req-ccefe7ac-d09b-40d1-aac9-85a88580e9e8 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Processing event network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:41:02.738237 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:02.744192 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:02.769761 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.054002 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.072068 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:03.072255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:03.072377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:03.072541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:03.072699 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:03.075052 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Terminating instance
May 14 04:41:03.173183 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733663.1728039, dee217de-fe65-44b9-8ef7-685eb8107b32 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:03.173304 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] VM Started (Lifecycle Event)
May 14 04:41:03.175158 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:41:03.178948 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:41:03.184302 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance spawned successfully.
May 14 04:41:03.184629 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:41:03.577742 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:41:03.596427 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.598070 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.616761 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.620104 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.638457 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.644610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:03.678172 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:03.683521 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:03.694785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.695021 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.695475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.695822 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.696185 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.696527 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:03.913477 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Instance destroyed successfully.
May 14 04:41:03.913894 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'resources' on Instance uuid bf06b769-3eb5-4246-8bd8-1f4e9f890dea {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:04.186400 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:41:04.186744 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733664.1865277, dee217de-fe65-44b9-8ef7-685eb8107b32 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:04.186824 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] VM Paused (Lifecycle Event)
May 14 04:41:04.202464 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Took 9.32 seconds to spawn the instance on the hypervisor.
May 14 04:41:04.202870 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:04.418545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-860741023',display_name='tempest-TestEncryptedCinderVolumes-server-860741023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-860741023',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:40:23Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-oapardok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:40:24Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=bf06b769-3eb5-4246-8bd8-1f4e9f890dea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:41:04.418971 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "27326c6b-9e63-4486-ad85-41f172862e28", "address": "fa:16:3e:fc:0a:95", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27326c6b-9e", "ovs_interfaceid": "27326c6b-9e63-4486-ad85-41f172862e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:04.419689 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:04.420000 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:41:04.421399 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.421690 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27326c6b-9e, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:04.424530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.426331 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:04.427545 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.428310 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.428509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d076f1b1-16b2-4bfa-be21-3e03dede15ea) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:04.428954 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.429537 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:04.429955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:04.431723 np0000000747 nova-compute[97971]: INFO os_vif [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:0a:95,bridge_name='br-int',has_traffic_filtering=True,id=27326c6b-9e63-4486-ad85-41f172862e28,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27326c6b-9e')
May 14 04:41:04.435233 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:41:04.435750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:41:04.435943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:04.539478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.103s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:04.539983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe236d5e-542f-4c94-9e86-4996f69ee35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:41:04.540180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:41:04.565474 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:41:04.565474 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:41:04.565474 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:04.565474 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:04.565474 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:04.565701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:41:04.565701 np0000000747 nova-compute[97971]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c (non-flash)
May 14 04:41:04.565701 np0000000747 nova-compute[97971]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:04.565701 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:04.565701 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:04.565842 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:41:04.565932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '174')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:41:04.566987 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c', '173')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:41:04.567766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361848bb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:41:04.567968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Removing multipathed devices sdc, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:41:04.568236 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flush multipath device 3300000002429704f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:41:04.596963 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:41:04.644467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:41:04.688964 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:04.692065 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:04.692065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:04.692438 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:04.694064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:04.694232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] No waiting events found dispatching network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:41:04.697747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:41:04.697918 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-d3e0ecdb-3e18-4365-8ea1-51358f334424 req-192f3170-6fcb-4fc0-b8b3-608550a57c22 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received unexpected event network-vif-plugged-08fab781-26b9-48e2-af73-af5af73d665c for instance with vm_state active and task_state None.
May 14 04:41:04.698319 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:41:04.700128 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:41:04.701130 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733664.7005122, dee217de-fe65-44b9-8ef7-685eb8107b32 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:04.701254 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] VM Resumed (Lifecycle Event)
May 14 04:41:04.712906 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Took 16.38 seconds to build instance.
May 14 04:41:04.718076 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:41:04.718277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:41:04.729754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.759677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.40.100,3260]
May 14 04:41:04.759677 np0000000747 nova-compute[97971]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.40.100,3260] successful.
May 14 04:41:04.759677 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.773975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.787840 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.815888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.50.100,3260]
May 14 04:41:04.815888 np0000000747 nova-compute[97971]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-fe236d5e-542f-4c94-9e86-4996f69ee35c, portal: 192.168.50.100,3260] successful.
May 14 04:41:04.815888 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.829514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:04.830606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:04.830794 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== disconnect_volume: return (395ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:41:04.831063 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:41:04.831299 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Deleting instance files /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea_del
May 14 04:41:04.831804 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Deletion of /opt/stack/data/nova/instances/bf06b769-3eb5-4246-8bd8-1f4e9f890dea_del complete
May 14 04:41:05.206225 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:05.209385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:05.214369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f61abd3d-076d-4a57-ba1a-2c856a7230ce tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.893s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:05.338376 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Took 1.76 seconds to destroy the instance on the hypervisor.
May 14 04:41:05.339091 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:41:05.339406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:41:05.339577 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:41:05.339925 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:05.405132 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:05.611656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:05.612223 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:05.711500 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99973645199998 future=<Future at 0x7435f84772c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:41:05.711893 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99933129100009 future=<Future at 0x7435f84772c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:41:05.712019 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999180771000283 future=<Future at 0x7435f84772c0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:41:05.935646 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7dcee86-218d-4843-8dff-04c575cd894e req-6473a0b7-4bf3-422e-8742-34bb3e41679d service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Received event network-vif-deleted-27326c6b-9e63-4486-ad85-41f172862e28 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:05.935780 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-d7dcee86-218d-4843-8dff-04c575cd894e req-6473a0b7-4bf3-422e-8742-34bb3e41679d service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Neutron deleted interface 27326c6b-9e63-4486-ad85-41f172862e28; detaching it from the instance and deleting it from the info cache
May 14 04:41:05.936425 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-d7dcee86-218d-4843-8dff-04c575cd894e req-6473a0b7-4bf3-422e-8742-34bb3e41679d service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:06.101855 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-changed-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:06.102367 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing instance network info cache due to event network-changed-08fab781-26b9-48e2-af73-af5af73d665c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:06.102535 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] Acquiring lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:06.102748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] Acquired lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:06.102881 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing network info cache for port 08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:06.116288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:41:06.391911 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:06.407753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:06.439388 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7dcee86-218d-4843-8dff-04c575cd894e req-6473a0b7-4bf3-422e-8742-34bb3e41679d service nova] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Detach interface failed, port_id=27326c6b-9e63-4486-ad85-41f172862e28, reason: Instance bf06b769-3eb5-4246-8bd8-1f4e9f890dea could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:41:06.605707 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:06.690810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:06.691194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:06.696604 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:41:06.696773 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Claim successful on node np0000000747
May 14 04:41:06.893947 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Took 1.55 seconds to deallocate network for instance.
May 14 04:41:07.003921 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:07.124601 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updated VIF entry in instance network info cache for port 08fab781-26b9-48e2-af73-af5af73d665c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:41:07.124960 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating instance_info_cache with network_info: [{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:07.450697 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Took 0.56 seconds to detach 1 volumes for instance.
May 14 04:41:07.626818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-22d87ff3-157d-4d65-9074-a3f959887ab4 req-16ec15a0-4b1c-4809-9321-e8e704185b94 service nova] Releasing lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:07.910654 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:07.910993 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:07.956368 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:08.413763 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:08.920810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.229s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:08.921232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:41:08.923484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.965s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:09.076578 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:09.076578 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:09.426838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:41:09.427100 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:41:09.427352 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:09.427609 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:09.439454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:09.496399 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c62e855d1b5408892ca249443d0f6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9d53da591a4a498317682637c55203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:41:09.581326 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:09.929689 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:41:09.947721 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Successfully created port: acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:41:10.088330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.167s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:10.133489 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deleted allocations for instance bf06b769-3eb5-4246-8bd8-1f4e9f890dea
May 14 04:41:10.357051 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Successfully updated port: acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:41:10.407633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-changed-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:10.407823 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Refreshing instance network info cache due to event network-changed-acd44c05-7623-4345-be99-d3f74359acec. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:10.408199 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] Acquiring lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:10.408290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] Acquired lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:10.408396 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Refreshing network info cache for port acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:10.435750 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:41:10.858967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:10.910252 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:10.988847 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:11.125684 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:11.145905 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0157a1f6-703a-431c-90dc-5548c6aff5ab tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "bf06b769-3eb5-4246-8bd8-1f4e9f890dea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.074s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:11.409722 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:11.445288 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:41:11.446396 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:41:11.446710 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Creating image(s)
May 14 04:41:11.447192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:11.447626 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:11.448671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:11.450371 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:11.455898 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:11.457151 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:11.568802 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:11.569374 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:11.570005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:11.570746 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:11.574995 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:11.575418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:11.628477 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8b3d697f-76f9-4a20-8642-6768009aa0a4 req-83e40935-d184-4976-ba2b-456178b93b34 service nova] Releasing lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:11.629100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquired lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:11.629299 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:41:11.671526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:11.672028 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:11.734944 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk 1073741824" returned: 0 in 0.063s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:11.735411 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:11.735782 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:11.832318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:11.832318 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:41:11.832318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:11.936112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:11.936630 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Cannot resize image /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:41:11.937025 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:41:11.937194 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Ensure instance console log exists: /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:41:11.937467 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:11.937714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:11.937842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:12.211737 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:12.371303 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:12.515066 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating instance_info_cache with network_info: [{"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:13.019634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Releasing lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:13.019634 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance network_info: |[{"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:41:13.019634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Start _get_guest_xml network_info=[{"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:41:13.026184 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:13.026972 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757', uuid='2b3041eb-a9b5-47df-b750-2181008063c1'), owner=OwnerMeta(userid='3c62e855d1b5408892ca249443d0f6f8', username='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member', projectid='cf9d53da591a4a498317682637c55203', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733673.0266511) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:41:13.028009 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:41:13.028296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:41:13.029411 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:41:13.029601 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:41:13.030453 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:41:13.030808 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:41:13.030960 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:41:13.031046 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:41:13.031166 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:41:13.031246 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:41:13.031331 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:41:13.031512 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:41:13.031580 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:41:13.031702 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:41:13.031800 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:41:13.031950 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:41:13.042524 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachscenariooldversion-server-1863757',id=70,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUsok+TadrY5cxuTIXo+yoMMlWiyQpoOssV4Quz2EKKFOwrzSnyuy5P1VQ2TTvZ2s74CtwZB0S1894ZpDo4XCsyWvVPYQPGz+HBIlx/E/kPDySs1S7j/7BJ54MFl+EJ1w==',key_name='tempest-keypair-873837677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf9d53da591a4a498317682637c55203',ramdisk_id='',reservation_id='r-i9rbx4jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c62e855d1b5408892ca249443d0f6f8',uuid=2b3041eb-a9b5-47df-b750-2181008063c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:41:13.042698 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converting VIF {"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:13.043316 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:13.043851 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] End _get_guest_xml xml=<domain type="qemu">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <uuid>2b3041eb-a9b5-47df-b750-2181008063c1</uuid>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <name>instance-00000046</name>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757</nova:name>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:41:13</nova:creationTime>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:user uuid="3c62e855d1b5408892ca249443d0f6f8">tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member</nova:user>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:project uuid="cf9d53da591a4a498317682637c55203">tempest-TestServerVolumeAttachScenarioOldVersion-1833525292</nova:project>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         <nova:port uuid="acd44c05-7623-4345-be99-d3f74359acec">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <system>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="serial">2b3041eb-a9b5-47df-b750-2181008063c1</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="uuid">2b3041eb-a9b5-47df-b750-2181008063c1</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </system>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <os>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </os>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <features>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </features>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   <devices>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.config"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:9a:ef:93"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <target dev="tapacd44c05-76"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </interface>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/console.log" append="off"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </serial>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <video>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </video>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </rng>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:   </devices>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: </domain>
May 14 04:41:13.548040 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Preparing to wait for external event network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachscenariooldversion-server-1863757',id=70,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUsok+TadrY5cxuTIXo+yoMMlWiyQpoOssV4Quz2EKKFOwrzSnyuy5P1VQ2TTvZ2s74CtwZB0S1894ZpDo4XCsyWvVPYQPGz+HBIlx/E/kPDySs1S7j/7BJ54MFl+EJ1w==',key_name='tempest-keypair-873837677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf9d53da591a4a498317682637c55203',ramdisk_id='',reservation_id='r-i9rbx4jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c62e855d1b5408892ca249443d0f6f8',uuid=2b3041eb-a9b5-47df-b750-2181008063c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:41:13.548040 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converting VIF {"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:13.551922 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:13.551922 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:41:13.552890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.553069 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:13.553369 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:41:13.554056 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.554216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ef6f498-1a6e-5d88-a98a-f105185d86c3', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:13.556058 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.556701 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:13.557896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.560121 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.560292 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacd44c05-76, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:13.560673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacd44c05-76, col_values=(('qos', UUID('9f1f4b1d-5e98-4c03-bc7a-7dfb1f92dd89')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:13.561216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacd44c05-76, col_values=(('external_ids', {'iface-id': 'acd44c05-7623-4345-be99-d3f74359acec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ef:93', 'vm-uuid': '2b3041eb-a9b5-47df-b750-2181008063c1'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:13.561717 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.563040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:13.567610 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:13.569284 np0000000747 nova-compute[97971]: INFO os_vif [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76')
May 14 04:41:15.086637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:15.086637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:15.086637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No VIF found with MAC fa:16:3e:9a:ef:93, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:41:15.086637 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Using config drive
May 14 04:41:15.593398 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:15.751173 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Creating config drive at /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.config
May 14 04:41:15.757835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprly6ky5y {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:15.820262 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprly6ky5y" returned: 0 in 0.062s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:16.267024 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.295984 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.394376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.409073 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.458516 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-74e06c4c-4d7c-41fc-a955-72d92e5b16f6 req-32817de5-8eeb-4813-acb7-4bd1a9fdbc4e service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:16.458731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74e06c4c-4d7c-41fc-a955-72d92e5b16f6 req-32817de5-8eeb-4813-acb7-4bd1a9fdbc4e service nova] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:16.459004 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74e06c4c-4d7c-41fc-a955-72d92e5b16f6 req-32817de5-8eeb-4813-acb7-4bd1a9fdbc4e service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:16.459188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-74e06c4c-4d7c-41fc-a955-72d92e5b16f6 req-32817de5-8eeb-4813-acb7-4bd1a9fdbc4e service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:16.462275 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-74e06c4c-4d7c-41fc-a955-72d92e5b16f6 req-32817de5-8eeb-4813-acb7-4bd1a9fdbc4e service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Processing event network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:41:16.610416 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.612395 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.616089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.641700 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:16.644267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:17.202062 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733677.2015698, 2b3041eb-a9b5-47df-b750-2181008063c1 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:17.202499 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:41:17.202717 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] VM Started (Lifecycle Event)
May 14 04:41:17.207730 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:41:17.210943 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance spawned successfully.
May 14 04:41:17.211253 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:41:17.706829 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:17.709337 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:17.722010 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:17.722189 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:17.722628 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:17.722920 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:17.726657 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:17.727039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:18.211946 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:41:18.214272 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733678.2127407, 2b3041eb-a9b5-47df-b750-2181008063c1 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:18.214272 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] VM Paused (Lifecycle Event)
May 14 04:41:18.232305 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Took 6.79 seconds to spawn the instance on the hypervisor.
May 14 04:41:18.232487 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] No waiting events found dispatching network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:41:18.515442 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-8d21bc23-ae30-4fda-b974-4ad4d3b03e92 req-a506cbd0-e4b8-4faf-a973-6d4580ea2253 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received unexpected event network-vif-plugged-acd44c05-7623-4345-be99-d3f74359acec for instance with vm_state active and task_state None.
May 14 04:41:18.561748 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:18.716724 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:18.718971 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733678.7187276, 2b3041eb-a9b5-47df-b750-2181008063c1 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:18.719272 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] VM Resumed (Lifecycle Event)
May 14 04:41:18.741952 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Took 12.12 seconds to build instance.
May 14 04:41:19.221764 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:19.224281 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:19.245639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.632s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:19.266601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:20.200738 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-changed-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:20.201087 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Refreshing instance network info cache due to event network-changed-acd44c05-7623-4345-be99-d3f74359acec. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:20.201087 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] Acquiring lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:20.201087 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] Acquired lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:20.201301 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Refreshing network info cache for port acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:20.704793 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:20.711654 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004034650000903639 future=<Future at 0x7435f84772c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:41:20.711776 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:41:20.712663 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] Emitting event <LifecycleEvent: 1778733665.711143, bf06b769-3eb5-4246-8bd8-1f4e9f890dea => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:20.712663 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] VM Stopped (Lifecycle Event)
May 14 04:41:21.031942 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:21.121793 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:21.222965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b2dc9abe-345d-4512-8692-0dabe6f16a8a tempest-TestVolumeBackupRestore-448826571 tempest-TestVolumeBackupRestore-448826571-project-member] [instance: bf06b769-3eb5-4246-8bd8-1f4e9f890dea] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:21.287139 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updated VIF entry in instance network info cache for port acd44c05-7623-4345-be99-d3f74359acec. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:41:21.287139 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating instance_info_cache with network_info: [{"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:21.411989 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:21.601964 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:21.603326 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:41:21.610002 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:21.610339 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:41:21.787604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bbe5b372-4851-4d4a-a16a-07547fbf3b74 req-4b04f986-de00-4ae7-97d4-ec41d40d9d82 service nova] Releasing lock "refresh_cache-2b3041eb-a9b5-47df-b750-2181008063c1" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:23.314955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:23.563337 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:23.610116 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:23.739079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:23.739248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:23.849959 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:24.115377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:24.115596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:24.115770 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:24.115907 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:41:24.240874 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:41:24.791933 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:24.792387 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:24.795549 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:41:24.795774 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Claim successful on node np0000000747
May 14 04:41:25.140766 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:41:25.142252 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:25.254010 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:25.254821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:25.345639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:25.351291 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:25.352210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:25.411324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:25.411817 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13510MB free_disk=72.71428680419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:41:25.411990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:25.488184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:26.046635 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:26.047106 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:26.105141 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:26.414827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:26.550355 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:27.056651 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.264s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:27.057157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.645s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:27.058057 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:41:27.566265 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:41:27.572265 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:41:27.575022 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:27.575257 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:27.693899 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaff71e5b25c4613a1f0c37315701570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f2a515353b48c6b1a74fd3510fd9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:41:28.041382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:28.085253 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:41:28.141983 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance dee217de-fe65-44b9-8ef7-685eb8107b32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:41:28.142143 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 2b3041eb-a9b5-47df-b750-2181008063c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:41:28.142270 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 57d5ba62-405e-4c96-b8e8-3ae20701f90e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:41:28.142476 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:41:28.142637 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:41:25 up 41 min,  2 users,  load average: 6.02, 6.43, 5.33\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '1', 'io_workload': '1', 'num_proj_cf9d53da591a4a498317682637c55203': '1', 'num_vm_building': '1', 'num_proj_e4f2a515353b48c6b1a74fd3510fd9ac': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:41:28.348824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:28.349006 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:28.442754 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Successfully created port: 857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:41:28.563737 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:28.588667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:41:28.851765 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:29.092970 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Booting with volume ae129ec9-6b6d-4262-983d-9016ee71c910 at /dev/vda
May 14 04:41:29.133869 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:41:29.145487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:41:29.168541 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:29.213255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:41:29.213577 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:41:29.224181 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:41:29.225168 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe9a:ef93', 'fe80::8b7:3cff:feee:f794'] 
May 14 04:41:29.225304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:41:29.225422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:41:29.225659 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:41:29.227282 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating existing volume attachment record: 99c338c8-7887-48b8-8b8d-9fcf4697412d {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:41:29.334824 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Successfully updated port: 857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:41:29.361292 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:41:29.361292 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.304s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:29.361779 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:41:29.390182 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-changed-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:29.390862 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Refreshing instance network info cache due to event network-changed-857a4e4a-7220-49f9-9b6d-93c2b8657bbb. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:29.391059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] Acquiring lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:29.391497 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] Acquired lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:29.391839 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Refreshing network info cache for port 857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:29.837707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:29.893453 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:29.897800 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:29.947543 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:30.082236 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:30.584228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a2ac9f2-cbb0-4f31-946d-79c4be7d00dd req-b5c30f35-f227-4c41-9115-0a17c69d37d6 service nova] Releasing lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:30.584819 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquired lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:30.584819 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:41:31.153730 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:31.336734 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:41:31.337813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:41:31.338028 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Creating image(s)
May 14 04:41:31.338317 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:41:31.338460 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Ensure instance console log exists: /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:41:31.340522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:31.340706 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:31.340837 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:31.346084 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:31.361799 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:31.362081 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:31.362403 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:31.362817 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:31.362817 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:41:31.363049 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.25 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:41:31.414519 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:31.490683 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating instance_info_cache with network_info: [{"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:31.993032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Releasing lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:31.993372 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance network_info: |[{"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:41:31.994264 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Start _get_guest_xml network_info=[{"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '99c338c8-7887-48b8-8b8d-9fcf4697412d', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '57d5ba62-405e-4c96-b8e8-3ae20701f90e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'serial': 'ae129ec9-6b6d-4262-983d-9016ee71c910'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:41:31.998521 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:31.999768 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-808136293', uuid='57d5ba62-405e-4c96-b8e8-3ae20701f90e'), owner=OwnerMeta(userid='aaff71e5b25c4613a1f0c37315701570', username='tempest-TestEncryptedCinderVolumes-100611717-project-member', projectid='e4f2a515353b48c6b1a74fd3510fd9ac', projectname='tempest-TestEncryptedCinderVolumes-100611717'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733691.9993172) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:41:32.000917 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:41:32.001214 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:41:32.002188 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:41:32.002380 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:41:32.003366 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:41:32.003565 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:41:32.003738 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:41:32.003859 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:41:32.004152 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:41:32.004152 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:41:32.004224 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:41:32.004390 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:41:32.004518 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:41:32.004674 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:41:32.004812 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:41:32.005064 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:41:32.014813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:41:32.015174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:41:32.015301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:32.015717 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:32.015950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:41:32.029114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:32.029671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:32.031129 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:32.031499 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:41:32.031885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:32.032225 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:41:32.044268 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:41:32.044268 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:32.050147 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:41:32.050147 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:32.059728 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910] added
May 14 04:41:32.059728 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:41:32.059728 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:32.059728 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:32.059728 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:32.059728 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:32.059728 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:32.059921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:41:32.060103 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:41:32.060277 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:41:32.063532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910] added
May 14 04:41:32.063532 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:41:32.063532 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:32.063532 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:32.063532 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:32.063532 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:32.063532 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:32.063721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:41:32.063913 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:41:32.064093 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:41:32.154580 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:32.154580 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:32.154744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:32.154923 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:32.155055 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] No waiting events found dispatching network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:41:32.155190 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-3a6b0e0f-4379-4a15-945a-41c86d035c39 req-7cf4e937-7b8d-4603-95dd-aab31a1b5a8b service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received unexpected event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb for instance with vm_state building and task_state spawning.
May 14 04:41:33.060778 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:41:33.064477 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:41:33.072736 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:41:33.072736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:41:33.078369 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:41:33.078369 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.084397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.088453 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.094207 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.094207 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.094207 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:33.094574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.094574 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.094574 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:33.100384 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.100384 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.100384 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:33.100635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.100635 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.100635 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:33.125239 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.40.100,3260]
May 14 04:41:33.125239 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.40.100,3260] successful.
May 14 04:41:33.125239 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.139504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.151813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.50.100,3260]
May 14 04:41:33.151813 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.50.100,3260] successful.
May 14 04:41:33.151813 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.157047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.157047 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.157047 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.157047 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.157047 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:33.157224 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.157224 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.157224 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.157224 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.157224 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:33.157606 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:33.157797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:41:33.158639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('7', '-', '-', 0) found on session 187 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:41:33.158816 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:41:33.163899 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:33.173400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 187 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:41:33.173400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:41:33.182580 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.182580 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.182580 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.182580 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.182580 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:33.182838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.182838 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:33.182838 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.182838 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:33.182838 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:33.183022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:33.183122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:41:33.183570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] HCTL ('8', '-', '-', 0) found on session 188 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:41:33.183725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:41:33.197757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Searching for a device in session 188 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:41:33.197757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:41:33.405307 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:33.405577 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:33.564668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:33.611240 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:41:33.611542 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:41:33.907908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:41:34.031766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:41:34.476036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:34.476036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:34.477439 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:41:34.480001 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Claim successful on node np0000000747
May 14 04:41:34.746414 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:35.055251 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Found WWN 330000000b838b526 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:41:35.055537 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:35.058346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000b838b526', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b838b526'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:41:35.058547 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b838b526', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b838b526'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:41:35.103812 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '57d5ba62-405e-4c96-b8e8-3ae20701f90e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'serial': 'ae129ec9-6b6d-4262-983d-9016ee71c910'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:41:35.103812 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:41:35.103812 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:41:35.104022 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:41:35.125713 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:41:35.125713 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:41:35.125713 np0000000747 nova-compute[97971]:     <volume>ae129ec9-6b6d-4262-983d-9016ee71c910</volume>
May 14 04:41:35.125713 np0000000747 nova-compute[97971]:   </usage>
May 14 04:41:35.125713 np0000000747 nova-compute[97971]: </secret>
May 14 04:41:35.125713 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:41:35.636090 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-808136293',display_name='tempest-TestEncryptedCinderVolumes-server-808136293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-808136293',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-t051tt3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:29Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=57d5ba62-405e-4c96-b8e8-3ae20701f90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:41:35.636560 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:35.637269 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:35.638396 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'pci_devices' on Instance uuid 57d5ba62-405e-4c96-b8e8-3ae20701f90e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:35.684225 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:35.684428 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:36.145042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] End _get_guest_xml xml=<domain type="qemu">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <uuid>57d5ba62-405e-4c96-b8e8-3ae20701f90e</uuid>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <name>instance-00000047</name>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-808136293</nova:name>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:41:31</nova:creationTime>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:user uuid="aaff71e5b25c4613a1f0c37315701570">tempest-TestEncryptedCinderVolumes-100611717-project-member</nova:user>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:project uuid="e4f2a515353b48c6b1a74fd3510fd9ac">tempest-TestEncryptedCinderVolumes-100611717</nova:project>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <nova:port uuid="857a4e4a-7220-49f9-9b6d-93c2b8657bbb">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <system>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="serial">57d5ba62-405e-4c96-b8e8-3ae20701f90e</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="uuid">57d5ba62-405e-4c96-b8e8-3ae20701f90e</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </system>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <os>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </os>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <features>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </features>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   <devices>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/disk.config"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <alias name="ua-ae129ec9-6b6d-4262-983d-9016ee71c910"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <serial>ae129ec9-6b6d-4262-983d-9016ee71c910</serial>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <encryption format="luks">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:         <secret type="passphrase" uuid="00a388e5-0273-44d3-9b42-eee4104ae943"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       </encryption>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:64:6a:09"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <target dev="tap857a4e4a-72"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </interface>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/console.log" append="off"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </serial>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <video>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </video>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </rng>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:   </devices>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]: </domain>
May 14 04:41:36.145042 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Preparing to wait for external event network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-808136293',display_name='tempest-TestEncryptedCinderVolumes-server-808136293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-808136293',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-t051tt3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:29Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=57d5ba62-405e-4c96-b8e8-3ae20701f90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:36.147829 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:41:36.149344 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.149344 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:36.149344 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:41:36.150167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.150167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42f735a4-088c-5165-bc3e-03be0fca9d4f', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:36.150474 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.151074 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:36.151437 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.153951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.153951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap857a4e4a-72, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:36.153951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap857a4e4a-72, col_values=(('qos', UUID('f2545d14-cba1-414d-9a70-ed66744a0700')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:36.153951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap857a4e4a-72, col_values=(('external_ids', {'iface-id': '857a4e4a-7220-49f9-9b6d-93c2b8657bbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:6a:09', 'vm-uuid': '57d5ba62-405e-4c96-b8e8-3ae20701f90e'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:36.154491 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.155744 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:36.161180 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.161180 np0000000747 nova-compute[97971]: INFO os_vif [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72')
May 14 04:41:36.187567 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:36.382964 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.415678 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:36.694485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.221s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:36.695038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:41:37.200292 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:41:37.201080 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:41:37.201588 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:37.201848 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:37.266935 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47f1acd1668e4ac08d6c058a60634819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15f4dfd4464a55b9bf21c4b7dec307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:41:37.676592 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:37.676745 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:37.676854 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] No VIF found with MAC fa:16:3e:64:6a:09, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:41:37.677262 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Using config drive
May 14 04:41:37.705162 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:41:37.717555 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Successfully created port: 58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:41:38.182496 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:38.186345 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Successfully updated port: 58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:41:38.212371 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:41:38.248335 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-changed-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:38.248473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Refreshing instance network info cache due to event network-changed-58724711-d912-40ab-a6e4-ff84d75187f1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:38.248697 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] Acquiring lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:38.248910 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] Acquired lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:38.248910 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Refreshing network info cache for port 58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:38.338430 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Creating config drive at /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/disk.config
May 14 04:41:38.342670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdda3lpiq {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:38.400798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdda3lpiq" returned: 0 in 0.058s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:38.688894 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:38.757001 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:38.819315 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:38.831451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:38.862127 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:38.959422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:38.980553 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:39.113412 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5630036c-aaf9-48b2-a412-750237971076 req-2e07b727-a6f9-4604-ab47-d5e749438f66 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:39.113939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5630036c-aaf9-48b2-a412-750237971076 req-2e07b727-a6f9-4604-ab47-d5e749438f66 service nova] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:39.114173 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5630036c-aaf9-48b2-a412-750237971076 req-2e07b727-a6f9-4604-ab47-d5e749438f66 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:39.114413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5630036c-aaf9-48b2-a412-750237971076 req-2e07b727-a6f9-4604-ab47-d5e749438f66 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:39.114609 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5630036c-aaf9-48b2-a412-750237971076 req-2e07b727-a6f9-4604-ab47-d5e749438f66 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Processing event network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:41:39.139298 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:39.143527 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:39.162775 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:39.222699 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:41:39.222699 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:41:39.222699 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Creating image(s)
May 14 04:41:39.223578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:39.224092 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:39.225036 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:39.226104 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:39.230475 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:39.231940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:39.325120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:39.325870 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:39.329742 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:39.329742 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:39.330608 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:39.331037 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:39.422895 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:39.424148 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:39.483884 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-161bef24-beea-4c13-b84f-c6e3f254dfbc req-d6ea4a8f-574c-488a-b6a2-ec898b410db6 service nova] Releasing lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:39.485967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquired lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:39.486165 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:41:39.490504 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk 1073741824" returned: 0 in 0.067s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:39.493597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:39.493597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:39.582857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:39.586636 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:41:39.586636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:39.676171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Cannot resize image /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Ensure instance console log exists: /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:39.678330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:40.094563 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:40.101745 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:40.247668 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:40.367136 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating instance_info_cache with network_info: [{"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:40.441526 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733700.4410775, 57d5ba62-405e-4c96-b8e8-3ae20701f90e => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:40.441988 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:41:40.442219 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] VM Started (Lifecycle Event)
May 14 04:41:40.444111 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:41:40.447634 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance spawned successfully.
May 14 04:41:40.448307 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:41:40.871493 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Releasing lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:40.871493 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance network_info: |[{"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:41:40.871759 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Start _get_guest_xml network_info=[{"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:41:40.875930 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:40.877280 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-378455957', uuid='519e07c2-32c7-460a-a83a-b64248c1ee17'), owner=OwnerMeta(userid='47f1acd1668e4ac08d6c058a60634819', username='tempest-SnapshotDataIntegrityTests-1275007703-project-member', projectid='8b15f4dfd4464a55b9bf21c4b7dec307', projectname='tempest-SnapshotDataIntegrityTests-1275007703'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733700.8768256) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:41:40.879212 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:41:40.879566 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:41:40.880569 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:41:40.880821 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:41:40.882043 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:41:40.882396 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:41:40.882556 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:41:40.882676 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:41:40.882810 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:41:40.882888 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:41:40.882981 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:41:40.883483 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:41:40.884192 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:41:40.885602 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:41:40.885784 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:41:40.885927 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:41:40.899590 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-378455957',display_name='tempest-SnapshotDataIntegrityTests-server-378455957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-snapshotdataintegritytests-server-378455957',id=72,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeT3oLtxiSXyXfwDkTImge5O5+DuzhMXBunIG0LxvQ4aWybYVjc20+NQGWAdrahtmU21OvV5Qm5ZTP2SjYG+R51O7N9I2FyrvYF6oda++VPmR9XXGXMD+UqNHZ3+5MNBw==',key_name='tempest-keypair-195804693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b15f4dfd4464a55b9bf21c4b7dec307',ramdisk_id='',reservation_id='r-i1d05f7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1275007703',owner_user_name='tempest-SnapshotDataIntegrityTests-1275007703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47f1acd1668e4ac08d6c058a60634819',uuid=519e07c2-32c7-460a-a83a-b64248c1ee17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:41:40.899803 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converting VIF {"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:40.900408 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:40.901046 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'pci_devices' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:40.945557 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:40.947791 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:40.953437 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:40.953611 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:40.953868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:40.954059 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:40.954589 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:40.954846 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:41.155823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.190906 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:41.190906 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:41.191030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:41.191137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:41.191310 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] No waiting events found dispatching network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:41:41.191482 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-06bbdbc6-cd5b-49b9-b62d-18b71b4b4982 req-ade07476-d5c3-4dba-be97-341e7ed1b017 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received unexpected event network-vif-plugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb for instance with vm_state building and task_state spawning.
May 14 04:41:41.404259 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] End _get_guest_xml xml=<domain type="qemu">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <uuid>519e07c2-32c7-460a-a83a-b64248c1ee17</uuid>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <name>instance-00000048</name>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-378455957</nova:name>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:41:40</nova:creationTime>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:user uuid="47f1acd1668e4ac08d6c058a60634819">tempest-SnapshotDataIntegrityTests-1275007703-project-member</nova:user>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:project uuid="8b15f4dfd4464a55b9bf21c4b7dec307">tempest-SnapshotDataIntegrityTests-1275007703</nova:project>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         <nova:port uuid="58724711-d912-40ab-a6e4-ff84d75187f1">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <system>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="serial">519e07c2-32c7-460a-a83a-b64248c1ee17</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="uuid">519e07c2-32c7-460a-a83a-b64248c1ee17</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </system>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <os>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </os>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <features>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </features>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   <devices>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.config"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:d4:2f:bf"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <target dev="tap58724711-d9"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </interface>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/console.log" append="off"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </serial>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <video>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </video>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </rng>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:   </devices>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]: </domain>
May 14 04:41:41.404259 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Preparing to wait for external event network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-378455957',display_name='tempest-SnapshotDataIntegrityTests-server-378455957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-snapshotdataintegritytests-server-378455957',id=72,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeT3oLtxiSXyXfwDkTImge5O5+DuzhMXBunIG0LxvQ4aWybYVjc20+NQGWAdrahtmU21OvV5Qm5ZTP2SjYG+R51O7N9I2FyrvYF6oda++VPmR9XXGXMD+UqNHZ3+5MNBw==',key_name='tempest-keypair-195804693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b15f4dfd4464a55b9bf21c4b7dec307',ramdisk_id='',reservation_id='r-i1d05f7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1275007703',owner_user_name='tempest-SnapshotDataIntegrityTests-1275007703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47f1acd1668e4ac08d6c058a60634819',uuid=519e07c2-32c7-460a-a83a-b64248c1ee17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:41:41.406232 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converting VIF {"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:41.406522 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:41.406573 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:41:41.408372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.408372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:41.408372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:41:41.408372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.408372 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43abea6f-c498-5955-a050-ef9e2526a8d4', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:41.410725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:41.413084 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.413258 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58724711-d9, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:41.413664 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58724711-d9, col_values=(('qos', UUID('c354b7db-37ef-4a4a-b04c-f6503af70e4b')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:41.413865 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58724711-d9, col_values=(('external_ids', {'iface-id': '58724711-d912-40ab-a6e4-ff84d75187f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:2f:bf', 'vm-uuid': '519e07c2-32c7-460a-a83a-b64248c1ee17'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:41.415190 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.416736 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:41.421316 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:41.424184 np0000000747 nova-compute[97971]: INFO os_vif [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9')
May 14 04:41:41.451246 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:41:41.451246 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733701.450128, 57d5ba62-405e-4c96-b8e8-3ae20701f90e => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:41.451246 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] VM Paused (Lifecycle Event)
May 14 04:41:41.460510 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Took 10.12 seconds to spawn the instance on the hypervisor.
May 14 04:41:41.460915 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:41.954030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:41.956052 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733701.955786, 57d5ba62-405e-4c96-b8e8-3ae20701f90e => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:41.956646 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] VM Resumed (Lifecycle Event)
May 14 04:41:41.971466 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Took 17.22 seconds to build instance.
May 14 04:41:42.243646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:42.459313 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:42.461285 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:42.473607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4163f7c7-a072-4de1-9873-0ae5ec2dbe7f tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.734s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:42.940349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:42.940625 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:41:42.940801 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No VIF found with MAC fa:16:3e:d4:2f:bf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:41:42.941465 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Using config drive
May 14 04:41:43.449473 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:43.597769 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Creating config drive at /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.config
May 14 04:41:43.602552 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz52ppkmw {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:43.672218 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz52ppkmw" returned: 0 in 0.069s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:43.788648 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-changed-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:43.788738 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Refreshing instance network info cache due to event network-changed-857a4e4a-7220-49f9-9b6d-93c2b8657bbb. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:43.788947 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] Acquiring lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:43.789102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] Acquired lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:43.789234 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Refreshing network info cache for port 857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:44.149675 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.181934 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.183555 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.271042 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.293359 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:44.499193 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.504569 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.527341 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:44.532862 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7a066c1f-f5d5-43f8-a242-6f970b15ef5f req-859c183b-aee9-4b37-a336-05434820bb8b service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:44.533506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a066c1f-f5d5-43f8-a242-6f970b15ef5f req-859c183b-aee9-4b37-a336-05434820bb8b service nova] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:44.533506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a066c1f-f5d5-43f8-a242-6f970b15ef5f req-859c183b-aee9-4b37-a336-05434820bb8b service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:44.533506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7a066c1f-f5d5-43f8-a242-6f970b15ef5f req-859c183b-aee9-4b37-a336-05434820bb8b service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:44.534119 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7a066c1f-f5d5-43f8-a242-6f970b15ef5f req-859c183b-aee9-4b37-a336-05434820bb8b service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Processing event network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:41:44.689517 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:44.853056 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updated VIF entry in instance network info cache for port 857a4e4a-7220-49f9-9b6d-93c2b8657bbb. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:41:44.853377 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating instance_info_cache with network_info: [{"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:44.966814 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733704.9663217, 519e07c2-32c7-460a-a83a-b64248c1ee17 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:44.967034 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] VM Started (Lifecycle Event)
May 14 04:41:44.969793 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:41:44.975809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:41:44.978991 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance spawned successfully.
May 14 04:41:44.980277 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:41:45.146868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:45.357188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-b7f96aa7-65cf-438c-af60-457588c9973e req-242213c8-f208-446e-8205-e12f99303394 service nova] Releasing lock "refresh_cache-57d5ba62-405e-4c96-b8e8-3ae20701f90e" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:45.472374 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:45.478593 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.488296 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:41:45.980836 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:41:45.981529 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733705.9808812, 519e07c2-32c7-460a-a83a-b64248c1ee17 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:45.981529 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] VM Paused (Lifecycle Event)
May 14 04:41:45.998145 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Took 6.77 seconds to spawn the instance on the hypervisor.
May 14 04:41:45.998145 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:46.415628 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:46.426643 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:46.485286 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:46.487820 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733706.48753, 519e07c2-32c7-460a-a83a-b64248c1ee17 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:41:46.487972 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] VM Resumed (Lifecycle Event)
May 14 04:41:46.512424 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Took 12.10 seconds to build instance.
May 14 04:41:46.621968 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:46.622450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:46.622594 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:46.622736 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:46.622838 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] No waiting events found dispatching network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:41:46.623050 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-43ef2852-79cb-45ef-b0a0-5844f0794863 req-b7fffaad-3f3d-4234-a33a-88112000e25b service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received unexpected event network-vif-plugged-58724711-d912-40ab-a6e4-ff84d75187f1 for instance with vm_state active and task_state None.
May 14 04:41:46.729035 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:46.729297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:46.854305 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:46.990698 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:41:46.994113 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:41:47.013833 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-aa79ba4e-befe-4e3b-a259-58f3b6b58bf8 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.608s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:47.232737 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:41:47.799082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:47.799550 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:47.803649 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:41:47.804049 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Claim successful on node np0000000747
May 14 04:41:47.878845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-changed-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:47.878973 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Refreshing instance network info cache due to event network-changed-58724711-d912-40ab-a6e4-ff84d75187f1. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:47.879175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] Acquiring lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:47.879329 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] Acquired lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:47.879497 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Refreshing network info cache for port 58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:48.383022 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:48.869020 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:49.082977 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updated VIF entry in instance network info cache for port 58724711-d912-40ab-a6e4-ff84d75187f1. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:41:49.083214 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating instance_info_cache with network_info: [{"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:49.156123 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:49.156423 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:49.585059 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77511077-b3b3-4b13-8453-e42897cdbb81 req-efea71db-102d-4f54-8ec0-b48af644593e service nova] Releasing lock "refresh_cache-519e07c2-32c7-460a-a83a-b64248c1ee17" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:49.659113 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:50.165735 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.366s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:50.166036 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:41:50.671543 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:41:50.672149 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:41:50.672149 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:50.672847 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:50.739106 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c6d7cdfffc143719c3a4dc67ab71e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21106f072baf4c4e8fcdb07b6c3a766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:41:51.018009 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:51.018397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:51.173417 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:41:51.245195 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Successfully created port: d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:41:51.416591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:51.428018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:51.520924 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:41:51.676997 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:41:51.701408 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Successfully updated port: d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:41:51.748089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:51.748307 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing instance network info cache due to event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:51.748435 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] Acquiring lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:51.748544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] Acquired lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:51.748907 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing network info cache for port d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:52.074902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:52.075079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:52.078420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:41:52.078559 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Claim successful on node np0000000747
May 14 04:41:52.182553 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Booting with volume b9086de3-db88-4f5a-b02d-842e4ca5ddf8 at /dev/vda
May 14 04:41:52.205512 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:52.225915 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:41:52.236450 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:41:52.251315 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:52.258962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:52.301390 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:41:52.301679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:41:52.311933 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:41:52.313043 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe9a:ef93', 'fe80::8b7:3cff:feee:f794', 'fe80::fc16:3eff:fe64:6a09', 'fe80::b038:ddff:fe7e:750d', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3'] 
May 14 04:41:52.313156 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:41:52.313273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:41:52.313476 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:41:52.313688 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating existing volume attachment record: 0faa6d75-f4b0-4a27-b42f-61e9d86694de {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:41:52.348560 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:52.968713 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:53.420900 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:41:53.421086 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:41:53.470767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-0f21dfdd-b289-4ee1-a941-0e9e0ae12220 req-f1424727-9210-4456-acf1-78de6922767c service nova] Releasing lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:53.471202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquired lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:53.471428 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:41:53.923653 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:41:54.037649 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:54.192630 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:54.331781 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:54.406007 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:41:54.407861 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:41:54.408181 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Creating image(s)
May 14 04:41:54.408589 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:41:54.408815 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Ensure instance console log exists: /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:41:54.409120 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:54.409368 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:54.409693 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:54.429903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.355s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:54.430380 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:41:54.833600 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Releasing lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:54.833873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance network_info: |[{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:41:54.834727 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Start _get_guest_xml network_info=[{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0faa6d75-f4b0-4a27-b42f-61e9d86694de', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '18f2c0cd-3716-4da2-929e-d4e8ac33f4ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'serial': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:41:54.837968 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:54.839035 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-63653127', uuid='18f2c0cd-3716-4da2-929e-d4e8ac33f4ad'), owner=OwnerMeta(userid='3c6d7cdfffc143719c3a4dc67ab71e4c', username='tempest-TestVolumeBootPattern-948121274-project-member', projectid='21106f072baf4c4e8fcdb07b6c3a766a', projectname='tempest-TestVolumeBootPattern-948121274'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733714.8387048) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:41:54.840171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:41:54.840516 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:41:54.841391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:41:54.841562 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:41:54.842387 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:41:54.842640 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:41:54.842775 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:41:54.842855 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:41:54.842988 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:41:54.843062 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:41:54.843201 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:41:54.843394 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:41:54.843495 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:41:54.843600 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:41:54.843712 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:41:54.843817 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:41:54.852677 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:41:54.852974 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:41:54.853193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:54.853500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:54.853686 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:41:54.864983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:54.865505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:41:54.865930 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:54.866363 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:41:54.866599 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:41:54.866903 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:41:54.877454 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:41:54.877454 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:54.882376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:41:54.882376 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:54.890449 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8] added
May 14 04:41:54.890449 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:41:54.890449 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:54.890449 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:54.890449 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:54.890449 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:54.890449 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:54.890791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:41:54.891002 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:41:54.891241 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:41:54.896513 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8] added
May 14 04:41:54.896513 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:41:54.896513 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:54.896513 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:54.896513 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:41:54.896513 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:41:54.896513 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:54.896723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:41:54.896858 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:41:54.896987 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:41:54.936654 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:41:54.936654 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:41:54.936875 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:54.937139 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:55.004866 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '727fba2b300b4d4596102544c1a6d398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9942017b2e7541a3971a106d228bd9d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:41:55.433443 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Successfully created port: 5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:41:55.439228 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Successfully updated port: 5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:41:56.812885 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:41:56.812885 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing instance network info cache due to event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] Acquiring lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] Acquired lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing network info cache for port 5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.812885 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.40.100,3260]
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.40.100,3260] successful.
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.50.100,3260]
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.50.100,3260] successful.
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('9', '-', '-', 0) found on session 189 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:41:56.818382 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] HCTL ('10', '-', '-', 0) found on session 190 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 189 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Searching for a device in session 190 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:56.818382 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:56.820077 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:56.820077 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:56.867216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:41:56.957498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:41:56.958853 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:41:56.959171 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Creating image(s)
May 14 04:41:56.959879 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:56.960095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:56.960714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:56.961370 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:56.965333 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:56.966409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:57.054669 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:57.055107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:57.055650 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:57.056089 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:57.058628 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:41:57.058938 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:57.146999 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:57.147704 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:57.178318 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-76e6e9a4-b09e-4db9-ab0e-b751d7ef432b req-baf4f403-03e0-4242-ac5c-823fab6081f6 service nova] Releasing lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:57.179218 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquired lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:41:57.179488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:41:57.200486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk 1073741824" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:57.200896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:57.201255 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:57.301843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:57.302337 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:41:57.302744 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:41:57.409789 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:41:57.410547 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Cannot resize image /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:41:57.411066 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:41:57.411336 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Ensure instance console log exists: /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:41:57.411955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:57.412233 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:57.412411 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:57.739146 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:41:57.754206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:57.754374 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:57.887440 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Found WWN 33000000058896594 for multipath device dm-4 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:41:57.888014 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:41:57.888227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000058896594', 'path': '/dev/dm-4', 'multipath_id': '33000000058896594'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:41:57.888364 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058896594', 'path': '/dev/dm-4', 'multipath_id': '33000000058896594'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:41:57.914009 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:41:58.038640 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:41:58.257907 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lazy-loading 'flavor' on Instance uuid 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:58.398337 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-63653127',display_name='tempest-TestVolumeBootPattern-server-63653127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-63653127',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s77w0im0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:52Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=18f2c0cd-3716-4da2-929e-d4e8ac33f4ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:41:58.398490 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:58.399043 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:58.399681 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'pci_devices' on Instance uuid 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:58.540385 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Releasing lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:41:58.540692 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance network_info: |[{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:41:58.542095 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Start _get_guest_xml network_info=[{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:41:58.544570 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:41:58.545607 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1330332910', uuid='5aaaf66c-6055-4f5a-add8-fb3bbe588f87'), owner=OwnerMeta(userid='727fba2b300b4d4596102544c1a6d398', username='tempest-VolumeMultiattachTests-2142682089-project-member', projectid='9942017b2e7541a3971a106d228bd9d6', projectname='tempest-VolumeMultiattachTests-2142682089'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733718.5453155) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:41:58.546706 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:41:58.547023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:41:58.547973 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:41:58.548150 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:41:58.548923 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:41:58.549420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:41:58.549420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:41:58.549420 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:41:58.549544 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:41:58.549710 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:41:58.549710 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:41:58.549847 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:41:58.549940 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:41:58.550043 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:41:58.550144 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:41:58.550273 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:41:58.560327 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1330332910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1330332910',id=74,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-vwahy63v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=5aaaf66c-6055-4f5a-add8-fb3bbe588f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:41:58.560582 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:58.560881 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:58.561261 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:41:58.902587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] End _get_guest_xml xml=<domain type="qemu">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <uuid>18f2c0cd-3716-4da2-929e-d4e8ac33f4ad</uuid>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <name>instance-00000049</name>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPattern-server-63653127</nova:name>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:41:54</nova:creationTime>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:user uuid="3c6d7cdfffc143719c3a4dc67ab71e4c">tempest-TestVolumeBootPattern-948121274-project-member</nova:user>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:project uuid="21106f072baf4c4e8fcdb07b6c3a766a">tempest-TestVolumeBootPattern-948121274</nova:project>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         <nova:port uuid="d3fb0d76-0a48-4486-82e1-1d22623c70cc">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <system>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="serial">18f2c0cd-3716-4da2-929e-d4e8ac33f4ad</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="uuid">18f2c0cd-3716-4da2-929e-d4e8ac33f4ad</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </system>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <os>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </os>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <features>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </features>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   <devices>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/disk.config"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <alias name="ua-b9086de3-db88-4f5a-b02d-842e4ca5ddf8"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-4"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <serial>b9086de3-db88-4f5a-b02d-842e4ca5ddf8</serial>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:44:4d:c3"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <target dev="tapd3fb0d76-0a"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </interface>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/console.log" append="off"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </serial>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <video>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </video>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </rng>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:   </devices>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]: </domain>
May 14 04:41:58.902587 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Preparing to wait for external event network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-63653127',display_name='tempest-TestVolumeBootPattern-server-63653127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-63653127',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s77w0im0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:52Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=18f2c0cd-3716-4da2-929e-d4e8ac33f4ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:41:58.904952 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:58.905252 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:58.905354 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:41:58.905823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.906179 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:58.906452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:41:58.907282 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.907462 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08d65766-5233-5f55-be6b-d4bfb4604466', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:58.908358 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.909268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:58.909540 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.911705 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.911933 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3fb0d76-0a, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:58.912340 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3fb0d76-0a, col_values=(('qos', UUID('fbf43adb-6f87-49bd-80f0-6bd8e514dfc4')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:58.912654 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3fb0d76-0a, col_values=(('external_ids', {'iface-id': 'd3fb0d76-0a48-4486-82e1-1d22623c70cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:4d:c3', 'vm-uuid': '18f2c0cd-3716-4da2-929e-d4e8ac33f4ad'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:58.914250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.914894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:58.918894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:58.919767 np0000000747 nova-compute[97971]: INFO os_vif [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a')
May 14 04:41:59.063575 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] End _get_guest_xml xml=<domain type="qemu">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <uuid>5aaaf66c-6055-4f5a-add8-fb3bbe588f87</uuid>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <name>instance-0000004a</name>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumeMultiattachTests-server-1330332910</nova:name>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:41:58</nova:creationTime>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:user uuid="727fba2b300b4d4596102544c1a6d398">tempest-VolumeMultiattachTests-2142682089-project-member</nova:user>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:project uuid="9942017b2e7541a3971a106d228bd9d6">tempest-VolumeMultiattachTests-2142682089</nova:project>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         <nova:port uuid="5c622dea-fc9d-4780-a6d2-fad9c4f037bd">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <system>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="serial">5aaaf66c-6055-4f5a-add8-fb3bbe588f87</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="uuid">5aaaf66c-6055-4f5a-add8-fb3bbe588f87</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </system>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <os>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </os>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <features>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </features>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   <devices>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.config"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </disk>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:38:99:9f"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <target dev="tap5c622dea-fc"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </interface>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/console.log" append="off"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </serial>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <video>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </video>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </rng>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:   </devices>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]: </domain>
May 14 04:41:59.063575 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Preparing to wait for external event network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1330332910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1330332910',id=74,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-vwahy63v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=5aaaf66c-6055-4f5a-add8-fb3bbe588f87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:41:59.066324 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:41:59.066923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.066923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:59.067000 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:41:59.067689 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.067875 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e1acf3e-d0a8-57f9-80f8-8bf39b962372', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:59.068532 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.069461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:59.074141 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.075846 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.076011 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c622dea-fc, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:59.076322 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c622dea-fc, col_values=(('qos', UUID('72412a13-95e2-4cf0-8c10-5ae0937970db')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:59.076489 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c622dea-fc, col_values=(('external_ids', {'iface-id': '5c622dea-fc9d-4780-a6d2-fad9c4f037bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:99:9f', 'vm-uuid': '5aaaf66c-6055-4f5a-add8-fb3bbe588f87'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:41:59.077254 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.078662 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:41:59.087062 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:41:59.088201 np0000000747 nova-compute[97971]: INFO os_vif [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc')
May 14 04:41:59.262689 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:00.330106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:00.330447 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:00.330447 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Attaching volume e1ab7229-6933-4c6b-8739-fb863c158477 to /dev/vdb
May 14 04:42:00.366778 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:00.376578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:42:00.397287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:00.439509 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:00.439629 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:00.439786 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] No VIF found with MAC fa:16:3e:44:4d:c3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:00.440483 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Using config drive
May 14 04:42:00.443818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:42:00.444148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:42:00.453035 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:42:00.454377 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fe9a:ef93', 'fe80::8b7:3cff:feee:f794', 'fe80::fc16:3eff:fe64:6a09', 'fe80::b038:ddff:fe7e:750d', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3'] 
May 14 04:42:00.454524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:42:00.454676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:42:00.454980 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:00.455556 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating existing volume attachment record: 1a7d2be5-348a-41a9-b056-db601f234170 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:42:00.604026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:00.604210 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:00.604341 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:38:99:9f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:00.604892 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Using config drive
May 14 04:42:00.947632 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:01.007334 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:42:01.007880 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:01.008141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:01.008756 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:01.009094 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:42:01.022253 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:01.023467 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:01.027400 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:01.027684 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:01.028310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:01.030855 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:01.041924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:01.041924 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:01.050192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:01.050192 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:01.057358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477] added
May 14 04:42:01.057358 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:01.057358 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:01.057358 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:01.057358 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:01.057358 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:01.057358 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:01.057551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:01.057759 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:01.057962 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:01.065015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477] added
May 14 04:42:01.065015 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:01.065015 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:01.065015 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:01.065015 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:01.065015 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:01.065015 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:01.065282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:01.065451 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:01.065634 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:01.082428 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Creating config drive at /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/disk.config
May 14 04:42:01.085453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp09qb95v9 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:01.118393 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:01.146907 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp09qb95v9" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:01.254737 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Creating config drive at /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.config
May 14 04:42:01.260312 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6oryin0_ {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:01.321079 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6oryin0_" returned: 0 in 0.060s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:01.444980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:01.875136 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:01.913356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:01.982112 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.011225 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.027803 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.030144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.058457 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:02.067763 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:02.076588 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:02.076588 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:02.090895 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:02.090895 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.098951 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.104599 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.115029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.117609 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-12480307-ab42-46c7-a8b9-4eb9933a4eda req-a2523b83-560e-412e-9ae5-22fdbf63fe67 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:02.117938 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-12480307-ab42-46c7-a8b9-4eb9933a4eda req-a2523b83-560e-412e-9ae5-22fdbf63fe67 service nova] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:02.118203 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-12480307-ab42-46c7-a8b9-4eb9933a4eda req-a2523b83-560e-412e-9ae5-22fdbf63fe67 service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:02.118581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-12480307-ab42-46c7-a8b9-4eb9933a4eda req-a2523b83-560e-412e-9ae5-22fdbf63fe67 service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:02.118758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-12480307-ab42-46c7-a8b9-4eb9933a4eda req-a2523b83-560e-412e-9ae5-22fdbf63fe67 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Processing event network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.127393 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.139984 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.140270 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:02.184674 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.50.100,3260]
May 14 04:42:02.184674 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.50.100,3260] successful.
May 14 04:42:02.184674 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.195731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-965a5d5f-0ae5-4d8f-a64e-0d4745cba253 req-9ab361ce-d916-4901-9d96-8115186391bd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:02.195731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-965a5d5f-0ae5-4d8f-a64e-0d4745cba253 req-9ab361ce-d916-4901-9d96-8115186391bd service nova] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:02.195839 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-965a5d5f-0ae5-4d8f-a64e-0d4745cba253 req-9ab361ce-d916-4901-9d96-8115186391bd service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:02.196258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-965a5d5f-0ae5-4d8f-a64e-0d4745cba253 req-9ab361ce-d916-4901-9d96-8115186391bd service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:02.196538 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-965a5d5f-0ae5-4d8f-a64e-0d4745cba253 req-9ab361ce-d916-4901-9d96-8115186391bd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Processing event network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:42:02.199968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.202125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.40.100,3260]
May 14 04:42:02.202125 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.40.100,3260] successful.
May 14 04:42:02.202125 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.207980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.223828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.224731 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.224953 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:02.225283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:02.225437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:02.226886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] HCTL ('13', '-', '-', 0) found on session 191 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:02.227009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.243689 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:02.243903 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:02.244163 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:02.244338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:02.246753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] HCTL ('14', '-', '-', 0) found on session 192 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:02.246980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:02.255318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Searching for a device in session 191 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:02.255318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:02.267913 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Searching for a device in session 192 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:02.268197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:02.315967 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.394196 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.396711 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.399144 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.419219 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:02.853209 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:42:02.853772 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733722.8532717, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:02.853944 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] VM Started (Lifecycle Event)
May 14 04:42:02.856139 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:42:02.860496 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance spawned successfully.
May 14 04:42:02.860496 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:42:02.887169 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:42:02.888980 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:42:02.891553 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance spawned successfully.
May 14 04:42:02.891879 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:42:03.025609 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:42:03.358880 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:03.363933 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:03.368094 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.368302 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.368751 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.369058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.369432 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.370229 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.400498 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.400662 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.400916 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.401128 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.401383 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.401580 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:03.866522 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:42:03.867044 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733723.866595, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:03.867044 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] VM Paused (Lifecycle Event)
May 14 04:42:03.878079 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Took 6.92 seconds to spawn the instance on the hypervisor.
May 14 04:42:03.878319 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:03.907450 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Took 9.50 seconds to spawn the instance on the hypervisor.
May 14 04:42:03.907564 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:04.040348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Found WWN 33000000016d29fce for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:42:04.040668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:04.040883 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '33000000016d29fce', 'path': '/dev/dm-7', 'multipath_id': '33000000016d29fce'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:04.041042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000016d29fce', 'path': '/dev/dm-7', 'multipath_id': '33000000016d29fce'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:42:04.043961 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lazy-loading 'flavor' on Instance uuid 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:04.078118 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:04.181407 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:04.182353 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:04.182559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:04.182955 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:04.183140 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] No waiting events found dispatching network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:04.183287 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-3d829ed6-4ef4-4b0d-8c8b-16b00ef0f115 req-bf884eb2-3379-41e7-bed7-5904d038f7ef service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received unexpected event network-vif-plugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc for instance with vm_state active and task_state None.
May 14 04:42:04.249268 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:04.249807 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:04.249969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:04.250088 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:04.250213 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] No waiting events found dispatching network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:04.250314 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-3c7439f0-8edf-489e-aa0f-8dc25cfcab58 req-7c5501de-895f-4f8b-bb04-fb511b33d488 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received unexpected event network-vif-plugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd for instance with vm_state active and task_state None.
May 14 04:42:04.369517 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:04.371629 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733724.3713992, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:04.371792 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] VM Resumed (Lifecycle Event)
May 14 04:42:04.392256 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Took 12.37 seconds to build instance.
May 14 04:42:04.416208 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Took 16.68 seconds to build instance.
May 14 04:42:04.547187 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Attempting to attach volume e1ab7229-6933-4c6b-8739-fb863c158477 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:42:04.548500 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:   <alias name="ua-e1ab7229-6933-4c6b-8739-fb863c158477"/>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:   <serial>e1ab7229-6933-4c6b-8739-fb863c158477</serial>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:04.548500 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:42:04.874473 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:04.877042 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:04.894005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.876s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:04.918102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.189s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:05.380572 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733725.3802643, 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:05.381841 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] VM Started (Lifecycle Event)
May 14 04:42:05.409449 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:05.409926 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing instance network info cache due to event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:05.410135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] Acquiring lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:05.410219 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] Acquired lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:05.410371 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing network info cache for port 5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:05.883496 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:05.885633 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:05.914824 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:06.204491 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:06.219868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:06.220083 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:06.220242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:06.220398 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] No VIF found with MAC fa:16:3e:9a:ef:93, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:06.307223 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:06.307420 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing instance network info cache due to event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:06.307793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] Acquiring lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:06.307793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] Acquired lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:06.307793 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing network info cache for port d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:06.342856 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updated VIF entry in instance network info cache for port 5c622dea-fc9d-4780-a6d2-fad9c4f037bd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:42:06.343158 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:06.388264 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733726.3879728, 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:06.388385 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] VM Paused (Lifecycle Event)
May 14 04:42:06.447195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:06.811063 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:06.845581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-09636b63-c87e-4e16-b82c-105837492829 req-aff1a28b-487e-4229-a220-71b75f91dc79 service nova] Releasing lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:06.890658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:06.893452 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733726.8931894, 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:06.893631 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] VM Resumed (Lifecycle Event)
May 14 04:42:07.077649 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:07.192176 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updated VIF entry in instance network info cache for port d3fb0d76-0a48-4486-82e1-1d22623c70cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:42:07.192490 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:07.396269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:07.398118 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:07.694323 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2cb0a806-2625-43de-8f14-aa001a54780e req-63663dd2-2ea7-49cb-b3f7-fdc1a45feb02 service nova] Releasing lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:07.770163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-5fd235ac-b0c5-4621-bc99-a7df28a227e8 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.440s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:08.896011 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:08.896454 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:09.079391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:09.399434 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Detaching volume e1ab7229-6933-4c6b-8739-fb863c158477
May 14 04:42:09.444865 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Attempting to driver detach volume e1ab7229-6933-4c6b-8739-fb863c158477 from mountpoint /dev/vdb
May 14 04:42:09.456167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Found disk vdb by alias ua-e1ab7229-6933-4c6b-8739-fb863c158477 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:42:09.457525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Found disk vdb by alias ua-e1ab7229-6933-4c6b-8739-fb863c158477 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:42:09.457697 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Attempting to detach device vdb from instance 2b3041eb-a9b5-47df-b750-2181008063c1 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:42:09.457996 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <alias name="ua-e1ab7229-6933-4c6b-8739-fb863c158477"/>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <serial>e1ab7229-6933-4c6b-8739-fb863c158477</serial>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:09.457996 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:42:09.463789 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Successfully detached device vdb from instance 2b3041eb-a9b5-47df-b750-2181008063c1 from the persistent domain config.
May 14 04:42:09.464064 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] (1/8): Attempting to detach device vdb with device alias ua-e1ab7229-6933-4c6b-8739-fb863c158477 from instance 2b3041eb-a9b5-47df-b750-2181008063c1 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:42:09.464385 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <alias name="ua-e1ab7229-6933-4c6b-8739-fb863c158477"/>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <serial>e1ab7229-6933-4c6b-8739-fb863c158477</serial>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:09.464385 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:42:09.936993 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733729.9366858, 2b3041eb-a9b5-47df-b750-2181008063c1 => ua-e1ab7229-6933-4c6b-8739-fb863c158477> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:42:09.938484 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e1ab7229-6933-4c6b-8739-fb863c158477 for instance 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:42:09.940672 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Successfully detached device vdb from instance 2b3041eb-a9b5-47df-b750-2181008063c1 from the live domain config.
May 14 04:42:09.941841 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:42:09.942069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:09.942243 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:09.942512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:09.942784 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e1ab7229-6933-4c6b-8739-fb863c158477', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:42:09.942904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:09.972164 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477 (non-flash)
May 14 04:42:09.972419 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:09.972552 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', '192')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:42:09.972646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', '192')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:09.973790 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477', '191')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:09.974766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618335a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'): ({'sdh'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:42:09.974983 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:42:09.975257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Flush multipath device 33000000016d29fce {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:42:10.005342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:10.049139 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:10.084236 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:42:10.084395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:42:10.085853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:42:10.097700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:42:10.097918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:42:10.108723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.138782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.40.100,3260]
May 14 04:42:10.138782 np0000000747 nova-compute[97971]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.40.100,3260] successful.
May 14 04:42:10.138782 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.154654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.167211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.197010 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.50.100,3260]
May 14 04:42:10.197010 np0000000747 nova-compute[97971]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-e1ab7229-6933-4c6b-8739-fb863c158477, portal: 192.168.50.100,3260] successful.
May 14 04:42:10.197010 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.212854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:10.213684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:10.213684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] <== disconnect_volume: return (270ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:10.213684 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:42:10.765033 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lazy-loading 'flavor' on Instance uuid 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:11.450392 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:11.770434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4aba5559-772c-4226-9f16-636b35504635 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.874s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:13.277461 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:13.277818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:13.277958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:13.278104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:13.278236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:13.280421 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Terminating instance
May 14 04:42:13.783396 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:42:13.807982 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:13.815786 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:13.827107 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:13.834198 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:13.861452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:13.962404 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:13.962838 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:13.963021 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:13.963157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:13.963321 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] No waiting events found dispatching network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:13.963472 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-486d010e-3e9d-416c-a586-27be6d342faa req-c2fa726b-d9bd-46d7-a5f3-224d67709442 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:14.080506 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.086948 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.094664 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.113976 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999599597999804 future=<Future at 0x743618487c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:14.115323 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998218167999767 future=<Future at 0x743618487c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:14.115521 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997989804999634 future=<Future at 0x743618487c80 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:14.116000 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Instance destroyed successfully.
May 14 04:42:14.116430 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lazy-loading 'resources' on Instance uuid 2b3041eb-a9b5-47df-b750-2181008063c1 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:14.618644 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1863757757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachscenariooldversion-server-1863757',id=70,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUsok+TadrY5cxuTIXo+yoMMlWiyQpoOssV4Quz2EKKFOwrzSnyuy5P1VQ2TTvZ2s74CtwZB0S1894ZpDo4XCsyWvVPYQPGz+HBIlx/E/kPDySs1S7j/7BJ54MFl+EJ1w==',key_name='tempest-keypair-873837677',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:41:18Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf9d53da591a4a498317682637c55203',ramdisk_id='',reservation_id='r-i9rbx4jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c62e855d1b5408892ca249443d0f6f8',uuid=2b3041eb-a9b5-47df-b750-2181008063c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:42:14.619158 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converting VIF {"id": "acd44c05-7623-4345-be99-d3f74359acec", "address": "fa:16:3e:9a:ef:93", "network": {"id": "364c4ffe-56b3-4156-86d6-96e4f1fce7d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1641616826-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf9d53da591a4a498317682637c55203", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd44c05-76", "ovs_interfaceid": "acd44c05-7623-4345-be99-d3f74359acec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:14.619489 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:14.619762 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:42:14.622093 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.622093 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacd44c05-76, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:14.633846 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.634750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.635853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.635853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f1f4b1d-5e98-4c03-bc7a-7dfb1f92dd89) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:14.636399 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.636955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:14.637214 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:14.639177 np0000000747 nova-compute[97971]: INFO os_vif [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:ef:93,bridge_name='br-int',has_traffic_filtering=True,id=acd44c05-7623-4345-be99-d3f74359acec,network=Network(364c4ffe-56b3-4156-86d6-96e4f1fce7d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd44c05-76')
May 14 04:42:14.639462 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Deleting instance files /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1_del
May 14 04:42:14.640191 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Deletion of /opt/stack/data/nova/instances/2b3041eb-a9b5-47df-b750-2181008063c1_del complete
May 14 04:42:15.146426 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 04:42:15.146946 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:42:15.147147 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:42:15.147237 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:42:15.147449 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:15.252381 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:15.674195 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ded7b1dc-cc64-46cc-824e-488dead7ba4f req-715d828d-c486-4d9f-8081-543f8ab73a9a service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-deleted-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:15.674195 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-ded7b1dc-cc64-46cc-824e-488dead7ba4f req-715d828d-c486-4d9f-8081-543f8ab73a9a service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Neutron deleted interface acd44c05-7623-4345-be99-d3f74359acec; detaching it from the instance and deleting it from the info cache
May 14 04:42:15.674195 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-ded7b1dc-cc64-46cc-824e-488dead7ba4f req-715d828d-c486-4d9f-8081-543f8ab73a9a service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:16.037888 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:16.038157 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] Acquiring lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:16.038357 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:16.038533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] Lock "2b3041eb-a9b5-47df-b750-2181008063c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:16.038712 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] No waiting events found dispatching network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:16.038865 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-77d9cc49-1c80-40b3-b576-e2c346ed7426 req-04e7aa8e-c8ee-4d60-a63b-46a5d3934fe3 service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Received event network-vif-unplugged-acd44c05-7623-4345-be99-d3f74359acec for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:16.127562 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:16.178239 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ded7b1dc-cc64-46cc-824e-488dead7ba4f req-715d828d-c486-4d9f-8081-543f8ab73a9a service nova] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Detach interface failed, port_id=acd44c05-7623-4345-be99-d3f74359acec, reason: Instance 2b3041eb-a9b5-47df-b750-2181008063c1 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:42:16.451130 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:16.629715 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Took 1.48 seconds to deallocate network for instance.
May 14 04:42:17.135939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:17.135939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:17.432487 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:17.432487 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:17.936639 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:18.441360 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:18.488743 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Deleted allocations for instance 2b3041eb-a9b5-47df-b750-2181008063c1
May 14 04:42:19.495731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-17dad31d-87f8-42dd-b774-8146fb3f79a4 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Lock "2b3041eb-a9b5-47df-b750-2181008063c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.218s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:19.643549 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:20.530260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:20.530717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:20.530717 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:20.530896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:20.531058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:20.534010 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Terminating instance
May 14 04:42:21.037490 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:42:21.054111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.056519 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.076213 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.079260 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.101090 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.203390 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:21.203583 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:21.203786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:21.203968 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:21.204200 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] No waiting events found dispatching network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:21.204289 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eb402537-f09d-4388-9176-08e4e2962b97 req-523a7a50-604c-436c-a94e-fa4bff1759ae service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:21.331673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.339550 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.355490 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999753041999611 future=<Future at 0x7435f81d8500 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:21.357605 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Instance destroyed successfully.
May 14 04:42:21.358043 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lazy-loading 'resources' on Instance uuid 57d5ba62-405e-4c96-b8e8-3ae20701f90e {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:21.504181 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.506522 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.861213 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-808136293',display_name='tempest-TestEncryptedCinderVolumes-server-808136293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testencryptedcindervolumes-server-808136293',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtGMWWdv8dSFFX7nlqfj5unD1pA/TjK8WunrpO+elKFdIul8K9a86zVWhVXG6ktZQzBpPLUiF2lBYiyX2KfoAEueMfJN9dKJX1dGs3vy9YpHQdaLIu3pDbaTA/DOJDK0Q==',key_name='tempest-TestEncryptedCinderVolumes-1275262406',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:41:41Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f2a515353b48c6b1a74fd3510fd9ac',ramdisk_id='',reservation_id='r-t051tt3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-100611717',owner_user_name='tempest-TestEncryptedCinderVolumes-100611717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:41:41Z,user_data=None,user_id='aaff71e5b25c4613a1f0c37315701570',uuid=57d5ba62-405e-4c96-b8e8-3ae20701f90e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:42:21.861213 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converting VIF {"id": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "address": "fa:16:3e:64:6a:09", "network": {"id": "8d375846-c078-49bd-bfb2-e3668773ba8e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1005183520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e4f2a515353b48c6b1a74fd3510fd9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap857a4e4a-72", "ovs_interfaceid": "857a4e4a-7220-49f9-9b6d-93c2b8657bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:21.861870 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:21.861870 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:42:21.862627 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.862820 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap857a4e4a-72, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:21.882745 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.884652 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:21.885103 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.885280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2545d14-cba1-414d-9a70-ed66744a0700) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:21.885797 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.886256 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:21.886571 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:21.888118 np0000000747 nova-compute[97971]: INFO os_vif [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:6a:09,bridge_name='br-int',has_traffic_filtering=True,id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb,network=Network(8d375846-c078-49bd-bfb2-e3668773ba8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857a4e4a-72')
May 14 04:42:21.890960 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:42:21.891222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:21.891345 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:21.891625 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:21.891928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae129ec9-6b6d-4262-983d-9016ee71c910', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:42:21.892057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:21.915849 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910 (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:21.916096 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:21.916096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '190')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:42:21.916295 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '187')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:21.916902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910', '188')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:21.917585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618411c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:42:21.917781 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:42:21.918008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Flush multipath device 330000000b838b526 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:42:21.952773 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:21.996273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:22.046416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:42:22.046416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:42:22.047558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:42:22.060525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:42:22.060744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:42:22.072028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.099333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.40.100,3260]
May 14 04:42:22.099333 np0000000747 nova-compute[97971]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.40.100,3260] successful.
May 14 04:42:22.099333 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.112598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.121985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.151625 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.50.100,3260]
May 14 04:42:22.151625 np0000000747 nova-compute[97971]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-ae129ec9-6b6d-4262-983d-9016ee71c910, portal: 192.168.50.100,3260] successful.
May 14 04:42:22.151625 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.164301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:22.165092 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:22.165234 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] <== disconnect_volume: return (273ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:22.165347 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:42:22.165554 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Deleting instance files /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e_del
May 14 04:42:22.166008 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Deletion of /opt/stack/data/nova/instances/57d5ba62-405e-4c96-b8e8-3ae20701f90e_del complete
May 14 04:42:22.671995 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Took 1.63 seconds to destroy the instance on the hypervisor.
May 14 04:42:22.672576 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:42:22.672964 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:42:22.673074 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:42:22.673304 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:22.732116 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:23.065291 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:23.192024 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fb563121-ba07-4ede-9d98-7a94e5e93b42 req-e1414666-5769-45e0-8c0c-b14facf05da5 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-deleted-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:23.192374 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-fb563121-ba07-4ede-9d98-7a94e5e93b42 req-e1414666-5769-45e0-8c0c-b14facf05da5 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Neutron deleted interface 857a4e4a-7220-49f9-9b6d-93c2b8657bbb; detaching it from the instance and deleting it from the info cache
May 14 04:42:23.192625 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-fb563121-ba07-4ede-9d98-7a94e5e93b42 req-e1414666-5769-45e0-8c0c-b14facf05da5 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:23.267279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:23.267522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] Acquiring lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:23.267747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:23.267940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:23.268624 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] No waiting events found dispatching network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:23.268801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-eeaa361e-5b42-48a2-b5f4-8fe96b7f90b9 req-9fa252f0-fead-4d7b-89bb-7029ddf438a2 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Received event network-vif-unplugged-857a4e4a-7220-49f9-9b6d-93c2b8657bbb for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:23.601579 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:23.602678 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:23.609845 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:23.610150 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:23.641381 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:23.695816 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fb563121-ba07-4ede-9d98-7a94e5e93b42 req-e1414666-5769-45e0-8c0c-b14facf05da5 service nova] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Detach interface failed, port_id=857a4e4a-7220-49f9-9b6d-93c2b8657bbb, reason: Instance 57d5ba62-405e-4c96-b8e8-3ae20701f90e could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:42:24.114887 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:24.115316 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:24.115316 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:24.115417 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:42:24.143102 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Took 1.47 seconds to deallocate network for instance.
May 14 04:42:24.686914 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:42:25.141167 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:42:25.142490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:25.193917 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:25.194184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:25.229122 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:25.231029 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:25.316383 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:25.324749 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:42:25.326914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:25.443524 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:25.444076 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:25.523064 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:25.523311 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:25.534757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:25.536965 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:42:25.537896 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:25.585334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:25.585720 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=12778MB free_disk=72.63103485107422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:42:25.585915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:25.787932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:25.788149 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:26.026903 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:26.293249 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:26.506391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:26.533558 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.339s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:26.536037 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.948s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:26.581226 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Deleted allocations for instance 57d5ba62-405e-4c96-b8e8-3ae20701f90e
May 14 04:42:26.791671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:26.886227 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:27.298752 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:27.585703 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance dee217de-fe65-44b9-8ef7-685eb8107b32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:42:27.585826 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 519e07c2-32c7-460a-a83a-b64248c1ee17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:42:27.585942 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:42:27.586070 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:42:27.586257 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:42:27.588261 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:42:25 up 42 min,  2 users,  load average: 5.45, 6.24, 5.33\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_21106f072baf4c4e8fcdb07b6c3a766a': '2', 'io_workload': '0', 'num_proj_8b15f4dfd4464a55b9bf21c4b7dec307': '1', 'num_proj_9942017b2e7541a3971a106d228bd9d6': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:42:27.591418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-4f2c2e61-e097-459d-854c-4980dc61dc8e tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Lock "57d5ba62-405e-4c96-b8e8-3ae20701f90e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.060s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:27.825161 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:27.825388 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:28.324574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:28.327851 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:28.492890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:28.493099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:28.493336 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attaching volume 89eb2717-e550-4375-aa3a-053fb6f155bc to /dev/vdb
May 14 04:42:28.534881 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:28.545439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:42:28.566308 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:28.613084 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:42:28.613349 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:42:28.621008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:42:28.622371 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe44:4dc3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c'] 
May 14 04:42:28.622685 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:42:28.622828 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:42:28.623120 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:28.623379 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating existing volume attachment record: 0bcaac0f-7c53-4259-bb8d-4020a8312109 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:42:28.835685 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:42:28.835917 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.302s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:28.836241 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.77 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:29.114127 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0005646290001095622 future=<Future at 0x743618487c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:29.114782 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] Emitting event <LifecycleEvent: 1778733734.113433, 2b3041eb-a9b5-47df-b750-2181008063c1 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:29.115068 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:29.115211 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] VM Stopped (Lifecycle Event)
May 14 04:42:29.116066 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.239147908999712 future=<Future at 0x7435f81d8500 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:29.116964 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.238230528999793 future=<Future at 0x7435f81d8500 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:29.170134 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:42:29.170428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:29.170585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:29.171019 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:29.171231 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:42:29.183591 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:29.184305 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:29.185121 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:29.185809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:29.186176 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:29.186492 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:29.203140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:29.203140 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:29.207144 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:29.207144 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:29.214069 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc] added
May 14 04:42:29.214069 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:29.214069 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:29.214069 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:29.214069 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:29.214069 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:29.214069 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:29.214351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:29.214503 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:29.214689 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:29.221923 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc] added
May 14 04:42:29.221923 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:29.221923 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:29.221923 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:29.221923 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:29.221923 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:29.221923 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:29.222180 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:29.222223 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:29.222358 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:29.619102 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-6bcf1616-2342-420f-a6a5-39d20d6de801 tempest-ImageDependencyTests-1563457996 tempest-ImageDependencyTests-1563457996-project-member] [instance: 2b3041eb-a9b5-47df-b750-2181008063c1] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:30.215324 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:30.222867 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:30.231218 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:30.231218 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:30.240704 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:30.240704 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.244982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.254793 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.260899 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.260899 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.260899 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.260899 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.260899 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:30.261085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.261085 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.261085 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.261085 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.261085 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:30.271745 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.271745 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.271745 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.271745 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.271745 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:30.271935 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.271935 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.271935 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.271935 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.271935 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:30.298771 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.50.100,3260]
May 14 04:42:30.298771 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.50.100,3260] successful.
May 14 04:42:30.298771 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.311437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.311917 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.40.100,3260]
May 14 04:42:30.311917 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.40.100,3260] successful.
May 14 04:42:30.311917 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.323746 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.331602 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.331959 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:30.332131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:30.332274 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:30.333379 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('7', '-', '-', 0) found on session 193 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:30.333518 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.343028 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:30.343313 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:30.343529 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:30.343529 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:30.344358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('8', '-', '-', 0) found on session 194 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:30.344460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:30.353658 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 193 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:30.353878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:30.360522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 194 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:30.360696 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:30.610135 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.610370 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.610748 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.611009 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.611211 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.611366 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:42:30.611566 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:30.611721 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 04:42:30.887562 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:31.113726 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:31.185830 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:42:31.509298 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:31.887503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:32.112271 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:32.112701 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 04:42:32.201511 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found WWN 3300000002e3e9ad8 for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:42:32.202223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:32.202223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000002e3e9ad8', 'path': '/dev/dm-0', 'multipath_id': '3300000002e3e9ad8'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:32.202223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002e3e9ad8', 'path': '/dev/dm-0', 'multipath_id': '3300000002e3e9ad8'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:42:32.206235 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:32.350084 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:32.614365 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] There are 0 instances to clean {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 04:42:32.614594 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:32.710402 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to attach volume 89eb2717-e550-4375-aa3a-053fb6f155bc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:42:32.711656 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:   <alias name="ua-89eb2717-e550-4375-aa3a-053fb6f155bc"/>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:   <serial>89eb2717-e550-4375-aa3a-053fb6f155bc</serial>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:32.711656 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:42:32.971109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:34.356039 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:34.356577 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:34.356577 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:34.356577 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No VIF found with MAC fa:16:3e:d4:2f:bf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:34.677914 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:35.110330 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:35.110525 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:35.113629 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:35.114327 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:35.586095 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:35.614587 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:42:35.910939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eb2d125c-84e5-4892-8f47-13e234d2f0a1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.418s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:36.279969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:36.280170 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:36.283357 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:42:36.283512 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Claim successful on node np0000000747
May 14 04:42:36.356236 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0009124060002250189 future=<Future at 0x7435f81d8500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:36.356445 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733741.3551352, 57d5ba62-405e-4c96-b8e8-3ae20701f90e => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:36.356560 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] VM Stopped (Lifecycle Event)
May 14 04:42:36.357473 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:36.510529 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:36.859185 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-14488f87-e773-47d4-934c-cb7eb73a2832 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 57d5ba62-405e-4c96-b8e8-3ae20701f90e] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:36.903385 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:37.332880 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Refreshing inventories for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 04:42:37.390182 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Updating ProviderTree inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 04:42:37.390383 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:42:37.437045 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Refreshing aggregate associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, aggregates: None {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 04:42:37.479791 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Refreshing trait associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, traits: COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_SOUND_MODEL_PCSPK,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 04:42:37.703563 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:37.703770 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:38.206252 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:38.714963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:38.715316 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:42:39.220920 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:42:39.221347 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:42:39.221676 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:39.222005 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:39.287408 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a90832041e54d5fbcc0052c86e715fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b003b259594616b507a7789de64b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:42:39.705140 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Successfully created port: 0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:42:39.721707 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:42:40.135556 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Successfully updated port: 0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:42:40.194464 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-changed-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:40.194909 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Refreshing instance network info cache due to event network-changed-0ed4a414-2c44-4377-8b86-3536e6008a2e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:40.195042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] Acquiring lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:40.195278 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] Acquired lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:40.195278 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Refreshing network info cache for port 0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:40.224631 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:42:40.637505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:40.697018 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:40.762054 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:42:40.887150 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:41.232359 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:42:41.233217 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:42:41.233417 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Creating image(s)
May 14 04:42:41.233823 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:41.233958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:41.234352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:41.234792 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:42:41.237252 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:42:41.238039 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:41.325453 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:41.325954 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:41.326470 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:41.326945 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:42:41.329455 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:42:41.329804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:41.389710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-85b6c557-1f71-4f6d-aacc-93bf6837e1aa req-8330640f-2786-4e91-81cd-9208306ab7ed service nova] Releasing lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:41.390391 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquired lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:41.390668 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:42:41.419495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:41.419964 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:41.481031 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk 1073741824" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:41.481443 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:41.481844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:41.512224 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:41.579064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.097s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:41.579536 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:42:41.579841 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:41.673589 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:41.674036 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Cannot resize image /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:42:41.674483 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:42:41.674701 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Ensure instance console log exists: /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:42:41.674995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:41.675223 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:41.675347 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:41.918454 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:41.948654 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:42:42.085132 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:42.200206 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating instance_info_cache with network_info: [{"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:42.702442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Releasing lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:42.702831 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance network_info: |[{"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:42:42.704242 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Start _get_guest_xml network_info=[{"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:42:42.708572 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:42:42.709786 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1877286069', uuid='2a81cc24-50ca-4fe7-8ebf-f22d91d41257'), owner=OwnerMeta(userid='3a90832041e54d5fbcc0052c86e715fd', username='tempest-TestServerVolumeAttachmentScenario-1539833072-project-member', projectid='86b003b259594616b507a7789de64b6f', projectname='tempest-TestServerVolumeAttachmentScenario-1539833072'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733762.7094264) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:42:42.711058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:42:42.711354 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:42:42.712369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:42:42.712561 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:42:42.713426 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:42:42.713777 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:42:42.713930 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:42:42.714023 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:42:42.714139 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:42:42.714220 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:42:42.714309 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:42:42.714460 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:42:42.714565 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:42:42.714708 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:42:42.714854 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:42:42.714985 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:42:42.725914 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1877286069',display_name='tempest-TestServerVolumeAttachmentScenario-server-1877286069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachmentscenario-server-1877286069',id=75,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXuuDvPzzZqhbn5vtO/UnLQ+wakQhHcqRTi+pbU7REkHnDvLYlWv8KaTc7bxtE8VXMJqHD472qfuji12DXWpZ2YtSiPPGHTCSx/9PUhnxYeJz3u3D51yzfbfUReCvUhnw==',key_name='tempest-keypair-1459038210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b003b259594616b507a7789de64b6f',ramdisk_id='',reservation_id='r-vsdhmdu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1539833072',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1539833072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a90832041e54d5fbcc0052c86e715fd',uuid=2a81cc24-50ca-4fe7-8ebf-f22d91d41257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:42:42.726097 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converting VIF {"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:42.726813 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:42.727364 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:42.863145 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:42.863569 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing instance network info cache due to event network-changed-d3fb0d76-0a48-4486-82e1-1d22623c70cc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:42.863804 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] Acquiring lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:42.863945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] Acquired lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:42.864112 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Refreshing network info cache for port d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:43.229839 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] End _get_guest_xml xml=<domain type="qemu">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <uuid>2a81cc24-50ca-4fe7-8ebf-f22d91d41257</uuid>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <name>instance-0000004b</name>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1877286069</nova:name>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:42:42</nova:creationTime>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:user uuid="3a90832041e54d5fbcc0052c86e715fd">tempest-TestServerVolumeAttachmentScenario-1539833072-project-member</nova:user>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:project uuid="86b003b259594616b507a7789de64b6f">tempest-TestServerVolumeAttachmentScenario-1539833072</nova:project>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         <nova:port uuid="0ed4a414-2c44-4377-8b86-3536e6008a2e">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <system>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="serial">2a81cc24-50ca-4fe7-8ebf-f22d91d41257</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="uuid">2a81cc24-50ca-4fe7-8ebf-f22d91d41257</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </system>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <os>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </os>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <features>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </features>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   <devices>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </disk>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.config"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </disk>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:d2:39:f1"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <target dev="tap0ed4a414-2c"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </interface>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/console.log" append="off"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </serial>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <video>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </video>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </rng>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:   </devices>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]: </domain>
May 14 04:42:43.229839 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Preparing to wait for external event network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1877286069',display_name='tempest-TestServerVolumeAttachmentScenario-server-1877286069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachmentscenario-server-1877286069',id=75,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXuuDvPzzZqhbn5vtO/UnLQ+wakQhHcqRTi+pbU7REkHnDvLYlWv8KaTc7bxtE8VXMJqHD472qfuji12DXWpZ2YtSiPPGHTCSx/9PUhnxYeJz3u3D51yzfbfUReCvUhnw==',key_name='tempest-keypair-1459038210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b003b259594616b507a7789de64b6f',ramdisk_id='',reservation_id='r-vsdhmdu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1539833072',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1539833072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a90832041e54d5fbcc0052c86e715fd',uuid=2a81cc24-50ca-4fe7-8ebf-f22d91d41257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converting VIF {"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:42:43.232459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.232986 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:43.233094 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:42:43.233919 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.234113 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0019f6fe-0005-5b74-a4e3-b2a545b5d119', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:43.234850 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.236699 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:43.238761 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.238940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed4a414-2c, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:43.239272 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed4a414-2c, col_values=(('qos', UUID('b45c30b9-ccba-48ce-8188-87cf7825dae6')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:43.239437 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed4a414-2c, col_values=(('external_ids', {'iface-id': '0ed4a414-2c44-4377-8b86-3536e6008a2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:39:f1', 'vm-uuid': '2a81cc24-50ca-4fe7-8ebf-f22d91d41257'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:43.240254 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.241755 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:43.245961 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.246554 np0000000747 nova-compute[97971]: INFO os_vif [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c')
May 14 04:42:43.366961 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:43.379019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:43.379211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:43.379402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:43.379549 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:43.382639 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:43.382639 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Terminating instance
May 14 04:42:43.655753 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:43.770972 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updated VIF entry in instance network info cache for port d3fb0d76-0a48-4486-82e1-1d22623c70cc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:42:43.771407 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [{"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:43.885237 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:42:43.905560 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.907937 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:43.924053 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.018608 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.027442 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.033313 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:44.033707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:44.033871 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:44.033971 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:44.034071 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] No waiting events found dispatching network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:44.034193 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7e074648-268b-4a88-9445-4af73c35d8e7 req-ea62c5df-f653-46c5-ae2a-adbad1ae0f49 service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:44.192448 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999661552999896 future=<Future at 0x7435f82f7440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:44.192786 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999306956000055 future=<Future at 0x7435f82f7440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:44.192917 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999143352999909 future=<Future at 0x7435f82f7440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:44.193901 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Instance destroyed successfully.
May 14 04:42:44.194406 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:44.273902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-55a4f2f3-1a98-41f0-b08e-9aeb4ec57a95 req-9236a9f8-96a4-4398-b7ab-3d2de04b4532 service nova] Releasing lock "refresh_cache-18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:44.610360 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:42:44.697227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-63653127',display_name='tempest-TestVolumeBootPattern-server-63653127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-63653127',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:42:03Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-s77w0im0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:42:04Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=18f2c0cd-3716-4da2-929e-d4e8ac33f4ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:42:44.697462 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "address": "fa:16:3e:44:4d:c3", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fb0d76-0a", "ovs_interfaceid": "d3fb0d76-0a48-4486-82e1-1d22623c70cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:44.697880 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:44.698091 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:42:44.699358 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.699601 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3fb0d76-0a, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:44.706280 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.707142 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:44.711774 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.712553 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.712765 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbf43adb-6f87-49bd-80f0-6bd8e514dfc4) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:44.713175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.713672 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:44.718356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:44.720461 np0000000747 nova-compute[97971]: INFO os_vif [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:4d:c3,bridge_name='br-int',has_traffic_filtering=True,id=d3fb0d76-0a48-4486-82e1-1d22623c70cc,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fb0d76-0a')
May 14 04:42:44.722181 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:42:44.722547 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:44.722736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:44.723084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:44.723381 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:42:44.723525 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:44.747306 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8 (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:44.747578 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:44.747578 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '194')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:42:44.747807 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '189')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:44.748462 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8', '190')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:44.749211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8278a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:42:44.749436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:42:44.749679 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 33000000058896594 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:42:44.761308 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:44.761449 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:44.761560 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No VIF found with MAC fa:16:3e:d2:39:f1, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:44.762064 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Using config drive
May 14 04:42:44.800103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:44.849283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:44.887027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:42:44.887176 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:42:44.888209 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:42:44.899821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:42:44.900006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:42:44.910174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:44.937434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.40.100,3260]
May 14 04:42:44.937434 np0000000747 nova-compute[97971]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.40.100,3260] successful.
May 14 04:42:44.937434 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:44.952484 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:44.964908 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:44.996476 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.50.100,3260]
May 14 04:42:44.996476 np0000000747 nova-compute[97971]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-b9086de3-db88-4f5a-b02d-842e4ca5ddf8, portal: 192.168.50.100,3260] successful.
May 14 04:42:44.996476 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:45.014029 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:45.014208 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:45.014335 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (291ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:45.014495 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:42:45.014792 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Deleting instance files /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad_del
May 14 04:42:45.015249 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Deletion of /opt/stack/data/nova/instances/18f2c0cd-3716-4da2-929e-d4e8ac33f4ad_del complete
May 14 04:42:45.112169 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 27.46 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:42:45.176781 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:45.176950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:45.268788 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:45.390435 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Creating config drive at /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.config
May 14 04:42:45.394381 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpatrba6h8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:45.451197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpatrba6h8" returned: 0 in 0.057s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:42:45.521949 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Took 1.64 seconds to destroy the instance on the hypervisor.
May 14 04:42:45.522883 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:42:45.523199 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:42:45.523330 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:42:45.523748 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:45.581064 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:45.679809 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Detaching volume 89eb2717-e550-4375-aa3a-053fb6f155bc
May 14 04:42:45.719674 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to driver detach volume 89eb2717-e550-4375-aa3a-053fb6f155bc from mountpoint /dev/vdb
May 14 04:42:45.728879 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-89eb2717-e550-4375-aa3a-053fb6f155bc {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:42:45.730636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-89eb2717-e550-4375-aa3a-053fb6f155bc {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:42:45.730848 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Attempting to detach device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:42:45.731210 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <alias name="ua-89eb2717-e550-4375-aa3a-053fb6f155bc"/>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <serial>89eb2717-e550-4375-aa3a-053fb6f155bc</serial>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:45.731210 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:42:45.737475 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config.
May 14 04:42:45.737475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] (1/8): Attempting to detach device vdb with device alias ua-89eb2717-e550-4375-aa3a-053fb6f155bc from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:42:45.737844 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <alias name="ua-89eb2717-e550-4375-aa3a-053fb6f155bc"/>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <serial>89eb2717-e550-4375-aa3a-053fb6f155bc</serial>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:45.737844 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:42:45.760578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:45.760800 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:45.826969 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:45.845362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:45.942714 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:45.997253 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e83c9418-b9b0-48f8-a999-2d160f2a9e1b req-4e572532-dc7f-4a14-96ba-cfbb38f6980b service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:45.997423 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e83c9418-b9b0-48f8-a999-2d160f2a9e1b req-4e572532-dc7f-4a14-96ba-cfbb38f6980b service nova] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:45.997592 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e83c9418-b9b0-48f8-a999-2d160f2a9e1b req-4e572532-dc7f-4a14-96ba-cfbb38f6980b service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:45.997774 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e83c9418-b9b0-48f8-a999-2d160f2a9e1b req-4e572532-dc7f-4a14-96ba-cfbb38f6980b service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:45.997900 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e83c9418-b9b0-48f8-a999-2d160f2a9e1b req-4e572532-dc7f-4a14-96ba-cfbb38f6980b service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Processing event network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:42:46.108540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:46.108748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] Acquiring lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:46.108932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:46.109095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:46.109641 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] No waiting events found dispatching network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:46.109796 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-unplugged-d3fb0d76-0a48-4486-82e1-1d22623c70cc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:46.109941 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Received event network-vif-deleted-d3fb0d76-0a48-4486-82e1-1d22623c70cc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:46.110093 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Neutron deleted interface d3fb0d76-0a48-4486-82e1-1d22623c70cc; detaching it from the instance and deleting it from the info cache
May 14 04:42:46.110244 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:46.150639 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.156790 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.158837 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.159772 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.175859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.246432 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733766.2456615, 519e07c2-32c7-460a-a83a-b64248c1ee17 => ua-89eb2717-e550-4375-aa3a-053fb6f155bc> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:42:46.247042 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-89eb2717-e550-4375-aa3a-053fb6f155bc for instance 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:42:46.249171 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config.
May 14 04:42:46.250358 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:42:46.250968 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:46.251081 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:46.251336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:46.251623 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89eb2717-e550-4375-aa3a-053fb6f155bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:42:46.251779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:42:46.264128 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:46.272209 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:46.274487 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:46.274487 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:46.274487 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:46.274487 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:46.274487 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:46.274634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:46.274634 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:46.274634 np0000000747 nova-compute[97971]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:46.274634 np0000000747 nova-compute[97971]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc (non-flash)
May 14 04:42:46.274634 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:46.274811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '194')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:42:46.274894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '194')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:46.276094 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc', '193')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:46.277572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74362d9b0360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:42:46.277839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:42:46.278056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flush multipath device 3300000002e3e9ad8 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:42:46.313847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:46.370109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:46.411912 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:42:46.412065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:42:46.413022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:42:46.425210 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:42:46.425378 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:42:46.436185 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.470806 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.40.100,3260]
May 14 04:42:46.470806 np0000000747 nova-compute[97971]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.40.100,3260] successful.
May 14 04:42:46.470806 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.483087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.492416 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.512108 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733766.5117855, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:46.512326 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] VM Started (Lifecycle Event)
May 14 04:42:46.514059 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:42:46.514226 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:46.516800 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:42:46.519037 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance spawned successfully.
May 14 04:42:46.519485 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:42:46.521776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.50.100,3260]
May 14 04:42:46.521776 np0000000747 nova-compute[97971]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-89eb2717-e550-4375-aa3a-053fb6f155bc, portal: 192.168.50.100,3260] successful.
May 14 04:42:46.521776 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.534344 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:46.534752 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:46.534852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== disconnect_volume: return (284ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:46.534955 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:42:46.618065 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-c5fb7aad-647b-4d4d-95fb-9bee8d3e1a48 req-167f12fe-af4b-499e-acb1-2b4d989b332b service nova] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Detach interface failed, port_id=d3fb0d76-0a48-4486-82e1-1d22623c70cc, reason: Instance 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:42:46.776213 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Took 1.25 seconds to deallocate network for instance.
May 14 04:42:47.017446 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:47.019311 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:47.026638 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.026824 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.027297 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.027739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.028157 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.028691 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:42:47.078069 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:47.269544 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:47.317818 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:42:47.521668 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:42:47.521873 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733767.5216885, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:47.521990 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] VM Paused (Lifecycle Event)
May 14 04:42:47.534122 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Took 6.30 seconds to spawn the instance on the hypervisor.
May 14 04:42:47.534391 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:47.822644 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:47.823551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:48.024103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:48.027329 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733768.0270746, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:48.027410 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] VM Resumed (Lifecycle Event)
May 14 04:42:48.042334 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Took 11.92 seconds to build instance.
May 14 04:42:48.075412 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:48.075716 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:48.075919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:48.076065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:48.076229 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] No waiting events found dispatching network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:48.076333 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-e6af4300-7e3c-4f35-840f-3d35629ff1eb req-7cddef18-a992-4079-8d0c-666afd48b48a service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received unexpected event network-vif-plugged-0ed4a414-2c44-4377-8b86-3536e6008a2e for instance with vm_state active and task_state None.
May 14 04:42:48.082642 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a9ef30a5-b2c5-4f7a-b486-7af4e0327a2c tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.906s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:48.093205 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:48.093419 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:48.330478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:48.330670 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:48.330860 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attaching volume 9547318a-6993-4d7a-ab40-2765d87a3a6d to /dev/vdb
May 14 04:42:48.367411 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:48.377302 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:42:48.394429 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:48.449559 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:42:48.450011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:42:48.460404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:42:48.461759 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:42:48.461964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:42:48.462119 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:42:48.462384 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:48.462697 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating existing volume attachment record: cd927b77-1c30-44fa-84ba-5a0912b81ff0 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:42:48.531015 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:48.535004 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:42:48.547757 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-21ada8a6-ff74-447b-a760-8d206f0b59dd tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.437s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:48.596850 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:49.014785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:42:49.015110 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:49.015252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:49.015588 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:49.015885 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:42:49.028304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:49.028808 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:49.029247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:49.029463 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:49.029793 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:49.029933 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:49.040646 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:49.040646 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:49.041701 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:49.041701 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:49.052329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d] added
May 14 04:42:49.052329 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:49.052329 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:49.052329 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:49.052329 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:49.052329 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:49.052329 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:49.052583 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:49.052949 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:49.052949 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:49.057064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d] added
May 14 04:42:49.057064 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:49.057064 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:49.057064 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:49.057064 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:49.057064 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:49.057064 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:49.057408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:49.057408 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:49.057563 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:49.106531 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:49.167116 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad
May 14 04:42:49.549864 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:49.550442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:49.715143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:50.054015 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:50.055044 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:50.058008 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:50.066574 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:50.066574 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:50.073804 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:50.073804 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.082557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.089966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.094846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.094846 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.094846 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:50.094846 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.094846 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.094846 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:50.101310 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.101310 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.101310 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:50.101468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.101468 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.101468 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:50.129786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.50.100,3260]
May 14 04:42:50.129786 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.50.100,3260] successful.
May 14 04:42:50.129786 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.140952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.145931 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-changed-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:50.146100 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Refreshing instance network info cache due to event network-changed-0ed4a414-2c44-4377-8b86-3536e6008a2e. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:50.146290 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] Acquiring lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:50.146551 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] Acquired lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:50.146831 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Refreshing network info cache for port 0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:50.147838 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.40.100,3260]
May 14 04:42:50.147838 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.40.100,3260] successful.
May 14 04:42:50.147838 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.155326 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('7', '-', '-', 0) found on session 195 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:50.155326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:50.159764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:50.171394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 195 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:50.171394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:50.175340 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.175340 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.175340 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.175340 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.175340 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:50.175690 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.175690 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:50.175690 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.175690 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:50.175690 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:50.176044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-ae978bcb-27ef-44e8-ba3d-8e6fe7c4b0b2 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "18f2c0cd-3716-4da2-929e-d4e8ac33f4ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.797s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:50.176804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:50.177053 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:50.177642 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('8', '-', '-', 0) found on session 196 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:50.177789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:50.191171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 196 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:50.191171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:50.649150 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:50.914929 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:51.029834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:42:51.033072 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updated VIF entry in instance network info cache for port 0ed4a414-2c44-4377-8b86-3536e6008a2e. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:42:51.033355 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating instance_info_cache with network_info: [{"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:51.058724 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:51.516043 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:51.535252 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8a1b3fa-3504-4fb5-af85-782a80cb88ea req-860c3694-34ef-43c5-80ca-988d03430734 service nova] Releasing lock "refresh_cache-2a81cc24-50ca-4fe7-8ebf-f22d91d41257" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:52.055942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found WWN 33000000021a28b6c for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:42:52.055942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:52.055942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000021a28b6c', 'path': '/dev/dm-0', 'multipath_id': '33000000021a28b6c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:52.055942 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021a28b6c', 'path': '/dev/dm-0', 'multipath_id': '33000000021a28b6c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:42:52.062011 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:52.126634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:52.126931 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:52.127194 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attaching volume 3a2607d5-4254-4aaf-a682-3aae104d1507 to /dev/vdb
May 14 04:42:52.168033 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:52.185133 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:42:52.208188 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:52.254370 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:42:52.254370 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:42:52.264240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:42:52.265425 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:feef:b53d', 'fe80::b8c1:aff:fefc:4b25', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:42:52.265540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:42:52.265677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:42:52.265891 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:52.266132 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating existing volume attachment record: 939ecf01-8cd4-4232-af52-5eaad682b6e1 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:42:52.310071 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-changed-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:52.310188 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing instance network info cache due to event network-changed-08fab781-26b9-48e2-af73-af5af73d665c. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:42:52.310383 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] Acquiring lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:42:52.310475 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] Acquired lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:42:52.310593 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Refreshing network info cache for port 08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:42:52.572637 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to attach volume 9547318a-6993-4d7a-ab40-2765d87a3a6d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:42:52.574674 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:   <alias name="ua-9547318a-6993-4d7a-ab40-2765d87a3a6d"/>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:   <serial>9547318a-6993-4d7a-ab40-2765d87a3a6d</serial>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:52.574674 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:42:52.821584 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:52.823197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:52.823466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:52.823732 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:52.823937 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:52.824221 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:52.828594 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Terminating instance
May 14 04:42:52.832338 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:42:52.832705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:52.832877 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:52.833433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:52.833698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:42:52.847246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:52.847842 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:52.848311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:52.849409 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:52.849409 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:52.849598 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:52.863856 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:52.863856 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:52.869213 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:52.869213 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:52.877750 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507] added
May 14 04:42:52.877750 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:52.877750 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:52.877750 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:52.877750 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:52.877750 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:52.877750 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:52.878078 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:52.878078 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:52.878186 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:52.883293 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507] added
May 14 04:42:52.883293 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:52.883293 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:52.883293 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:52.883293 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:52.883293 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:52.883293 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:52.883508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:52.883634 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:52.883829 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:53.128843 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:53.261199 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updated VIF entry in instance network info cache for port 08fab781-26b9-48e2-af73-af5af73d665c. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:42:53.261199 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating instance_info_cache with network_info: [{"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:53.334904 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:42:53.361638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:53.375923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:53.379990 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:53.401823 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:53.531788 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:53.531788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:53.531788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:53.531788 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:53.531788 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] No waiting events found dispatching network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:53.532393 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d058f223-4bf7-45b8-8255-2b04e8993a9e req-b5b13927-09f2-4e4d-a647-60d0c1a00576 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:53.659266 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999673405000067 future=<Future at 0x7436183a3680 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:53.659510 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Instance destroyed successfully.
May 14 04:42:53.660362 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lazy-loading 'resources' on Instance uuid dee217de-fe65-44b9-8ef7-685eb8107b32 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:53.762368 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8a5913c0-9db5-4ccc-b18b-389c56630514 req-29037a1e-bf05-44ae-840c-d0cae44ec734 service nova] Releasing lock "refresh_cache-dee217de-fe65-44b9-8ef7-685eb8107b32" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:42:53.878570 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:53.884153 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:53.890009 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:53.890009 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:53.895762 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:53.895762 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.901825 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.906726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.913593 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.913593 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.913593 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.913593 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.913593 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:53.913861 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.913861 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.913861 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.913861 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.913861 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:53.920077 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.920077 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.920077 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.920077 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.920077 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:53.920257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.920257 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.920257 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.920257 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.920257 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:53.953998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.50.100,3260]
May 14 04:42:53.953998 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.50.100,3260] successful.
May 14 04:42:53.953998 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.959437 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.40.100,3260]
May 14 04:42:53.959437 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.40.100,3260] successful.
May 14 04:42:53.959437 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.965668 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.973463 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.980963 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.981168 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:53.981352 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:53.981465 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:53.982193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('9', '-', '-', 0) found on session 197 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:53.982299 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.987730 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:53.987886 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:53.988107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:53.988204 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:42:53.988916 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('10', '-', '-', 0) found on session 198 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:42:53.989047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:42:53.995473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 197 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:53.995783 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:54.004801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 198 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:42:54.004801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:42:54.163561 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652886939',display_name='tempest-TestVolumeBootPattern-server-652886939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpattern-server-652886939',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbzzqs81uHIFHv/iANTSEB27DVVGxiROcQD63Vbz4D0ZgSRys+NuC9RegXIMHMyRot2JwFJ+jsiXP7/lSW3HhO7oJHaYNQPrhMqOzYnLF8iVMTx2t2OpA4ocXkQy9kSIA==',key_name='tempest-TestVolumeBootPattern-1920123733',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:41:04Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21106f072baf4c4e8fcdb07b6c3a766a',ramdisk_id='',reservation_id='r-k8dcv9cf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-948121274',owner_user_name='tempest-TestVolumeBootPattern-948121274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:41:04Z,user_data=None,user_id='3c6d7cdfffc143719c3a4dc67ab71e4c',uuid=dee217de-fe65-44b9-8ef7-685eb8107b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:42:54.164007 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converting VIF {"id": "08fab781-26b9-48e2-af73-af5af73d665c", "address": "fa:16:3e:ef:b5:3d", "network": {"id": "52ece102-70fe-42e9-a53c-df805272fd9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-814955444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21106f072baf4c4e8fcdb07b6c3a766a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fab781-26", "ovs_interfaceid": "08fab781-26b9-48e2-af73-af5af73d665c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:42:54.164345 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:42:54.164575 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:42:54.167268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.167268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08fab781-26, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:54.180363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.180363 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:54.181296 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.182283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.182283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f214b528-08dc-4c42-acab-2cde4ae4f3c7) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:42:54.183159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.183159 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:42:54.183827 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:54.185346 np0000000747 nova-compute[97971]: INFO os_vif [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:b5:3d,bridge_name='br-int',has_traffic_filtering=True,id=08fab781-26b9-48e2-af73-af5af73d665c,network=Network(52ece102-70fe-42e9-a53c-df805272fd9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08fab781-26')
May 14 04:42:54.187533 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:42:54.187851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:54.187988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:54.215850 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:54.215991 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:54.216102 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:54.216198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:38:99:9f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:54.849063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:42:55.584161 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:55.585983 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:55.586128 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] Acquiring lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:55.586287 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:55.586389 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:55.586509 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] No waiting events found dispatching network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:42:55.586598 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-177c889f-603e-4de7-8af4-84b810878299 req-6617c0a6-568c-40ba-adc7-adac8a596d47 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-unplugged-08fab781-26b9-48e2-af73-af5af73d665c for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:42:55.761945 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-71f60466-6689-4e73-b2d6-4f5f634e4b7e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.431s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:55.763095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.178s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:55.863405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found WWN 3300000001bbb7a03 for multipath device dm-4 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:42:55.863707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:55.864064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000001bbb7a03', 'path': '/dev/dm-4', 'multipath_id': '3300000001bbb7a03'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:55.864220 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001bbb7a03', 'path': '/dev/dm-4', 'multipath_id': '3300000001bbb7a03'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:42:55.864587 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.676s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:55.865046 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58342884-b35c-4472-b28e-033d1245564a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:42:55.865197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:42:55.867152 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:55.890498 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:55.890854 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:55.890854 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '198')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:42:55.891127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '184')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:55.891736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a', '183')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:42:55.892375 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8496ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:42:55.892549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:42:55.892782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Flush multipath device 3300000004fed08e9 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:42:55.964767 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:56.006608 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:42:56.053167 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:42:56.054237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:42:56.054237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:42:56.066054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:42:56.066230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:42:56.077117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.116086 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260]
May 14 04:42:56.116086 np0000000747 nova-compute[97971]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.40.100,3260] successful.
May 14 04:42:56.116086 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.131376 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.143020 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.173985 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260]
May 14 04:42:56.173985 np0000000747 nova-compute[97971]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-58342884-b35c-4472-b28e-033d1245564a, portal: 192.168.50.100,3260] successful.
May 14 04:42:56.173985 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.190003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:56.190233 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:42:56.190361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] <== disconnect_volume: return (2002ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:56.190497 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:42:56.190815 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Deleting instance files /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32_del
May 14 04:42:56.191303 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Deletion of /opt/stack/data/nova/instances/dee217de-fe65-44b9-8ef7-685eb8107b32_del complete
May 14 04:42:56.267796 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:42:56.370282 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to attach volume 3a2607d5-4254-4aaf-a682-3aae104d1507 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:42:56.371807 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:   <alias name="ua-3a2607d5-4254-4aaf-a682-3aae104d1507"/>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:   <serial>3a2607d5-4254-4aaf-a682-3aae104d1507</serial>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]: </disk>
May 14 04:42:56.371807 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:42:56.517273 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:56.697341 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Took 3.36 seconds to destroy the instance on the hypervisor.
May 14 04:42:56.697933 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:42:56.698020 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:42:56.698108 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:42:56.698296 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:56.762456 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:42:57.273636 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:57.467395 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:42:57.651281 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-570e2630-9396-4d7f-b515-cada0feb3bf1 req-432f24dc-c64b-44a1-b7cc-b346ddf679d8 service nova] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Received event network-vif-deleted-08fab781-26b9-48e2-af73-af5af73d665c {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:42:57.969301 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Took 1.27 seconds to deallocate network for instance.
May 14 04:42:58.004047 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:58.004218 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:58.004357 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:42:58.004489 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No VIF found with MAC fa:16:3e:d4:2f:bf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:42:58.189309 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:58.189463 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:58.189647 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attaching volume 7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 to /dev/vdc
May 14 04:42:58.228811 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:58.240889 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:42:58.266089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:42:58.309948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:42:58.310226 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:42:58.322714 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:42:58.323875 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:42:58.324005 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:42:58.324106 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:42:58.324394 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:42:58.324734 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating existing volume attachment record: e371e986-63c2-4345-9282-3b9de34f1225 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:42:58.513079 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:42:58.905978 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5aaaf66c-6055-4f5a-add8-fb3bbe588f87', 'attached_at': '', 'detached_at': '', 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'serial': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:42:58.908962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:42:58.909277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:42:58.909410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:58.909845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:58.910044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:42:58.923681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:58.924143 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:42:58.924510 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:58.924737 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:58.925022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:42:58.925187 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:58.935509 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:58.935509 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:58.940991 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:42:58.940991 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:58.946083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6] added
May 14 04:42:58.946083 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:58.946083 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:58.946083 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:58.946083 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:58.946083 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:58.946083 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:58.946303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:58.946363 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:58.946536 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:58.951978 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6] added
May 14 04:42:58.951978 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:42:58.951978 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:58.951978 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:58.951978 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:42:58.951978 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:42:58.951978 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:58.952212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:42:58.952212 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:42:58.952322 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:42:59.019820 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:42:59.020192 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:42:59.183858 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:42:59.192418 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00033346000009260024 future=<Future at 0x7435f82f7440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:59.192916 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Emitting event <LifecycleEvent: 1778733764.191996, 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:42:59.193126 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:59.193253 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] VM Stopped (Lifecycle Event)
May 14 04:42:59.194630 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.462137385000005 future=<Future at 0x7436183a3680 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:59.194814 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.461925270999927 future=<Future at 0x7436183a3680 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:42:59.235826 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:42:59.236073 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:42:59.563854 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf478660-6f1a-47db-acb0-f7fb173495f1 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.437s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:42:59.696383 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 18f2c0cd-3716-4da2-929e-d4e8ac33f4ad] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:42:59.739045 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:42:59.947025 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:42:59.952808 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:59.960261 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:59.960261 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:42:59.967177 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:42:59.967177 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:59.973178 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:59.980677 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:42:59.987792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.987792 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.987792 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.987792 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.987792 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:42:59.987992 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.987992 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.987992 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.987992 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.987992 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:42:59.999848 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.999848 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:42:59.999848 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.999848 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:42:59.999848 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:00.000049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.000049 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.000049 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.000049 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.000049 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:00.027107 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.50.100,3260]
May 14 04:43:00.027107 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.50.100,3260] successful.
May 14 04:43:00.027107 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:00.040266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:00.050080 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.40.100,3260]
May 14 04:43:00.050080 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.40.100,3260] successful.
May 14 04:43:00.050080 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.055423 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.055590 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:00.055895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:00.056033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:00.056855 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('11', '-', '-', 0) found on session 199 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:00.056998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:00.063169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:00.074099 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 199 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:00.074326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.079322 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:00.079522 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:00.079792 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:00.079897 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:00.080627 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('12', '-', '-', 0) found on session 200 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:00.080732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:00.094755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 200 and hctl ['12', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:00.245007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.225s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:00.294477 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Deleted allocations for instance dee217de-fe65-44b9-8ef7-685eb8107b32
May 14 04:43:01.095540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 200 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:01.095989 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:01.302303 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8e3e2003-3865-4458-8ab5-d7502a1dffc5 tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Lock "dee217de-fe65-44b9-8ef7-685eb8107b32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.479s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:01.519268 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:01.941635 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found WWN 3300000002ebf4591 for multipath device dm-1 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:01.942101 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:01.943182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000002ebf4591', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000002ebf4591'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:01.943367 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002ebf4591', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000002ebf4591'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:01.945660 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:43:01.945949 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:43:01.946160 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:43:01.965066 np0000000747 nova-compute[97971]: WARNING os_brick.encryptors.luks [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 14 04:43:01.965555 np0000000747 nova-compute[97971]: WARNING stevedore.named [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 14 04:43:01.965847 np0000000747 nova-compute[97971]: WARNING castellan.key_manager [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:43:01.966061 np0000000747 nova-compute[97971]: WARNING nova.keymgr.conf_key_mgr [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 14 04:43:01.966777 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7436184f5670>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '5aaaf66c-6055-4f5a-add8-fb3bbe588f87', 'attached_at': '', 'detached_at': '', 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'serial': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'} {{(pid=97971) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 14 04:43:01.966966 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors.luks [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] formatting encrypted volume /dev/dm-1 {{(pid=97971) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 14 04:43:03.092920 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:03.093297 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:03.595286 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Detaching volume 3a2607d5-4254-4aaf-a682-3aae104d1507
May 14 04:43:03.637249 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to driver detach volume 3a2607d5-4254-4aaf-a682-3aae104d1507 from mountpoint /dev/vdb
May 14 04:43:03.641558 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-3a2607d5-4254-4aaf-a682-3aae104d1507 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:03.642764 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-3a2607d5-4254-4aaf-a682-3aae104d1507 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:03.642879 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Attempting to detach device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:43:03.643165 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <alias name="ua-3a2607d5-4254-4aaf-a682-3aae104d1507"/>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <serial>3a2607d5-4254-4aaf-a682-3aae104d1507</serial>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:03.643165 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:03.648915 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config.
May 14 04:43:03.649144 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] (1/8): Attempting to detach device vdb with device alias ua-3a2607d5-4254-4aaf-a682-3aae104d1507 from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:43:03.649393 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <alias name="ua-3a2607d5-4254-4aaf-a682-3aae104d1507"/>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-4"/>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <serial>3a2607d5-4254-4aaf-a682-3aae104d1507</serial>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:03.649393 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:04.199433 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:04.222188 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:04.268809 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733784.2684374, 519e07c2-32c7-460a-a83a-b64248c1ee17 => ua-3a2607d5-4254-4aaf-a682-3aae104d1507> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:43:04.270064 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3a2607d5-4254-4aaf-a682-3aae104d1507 for instance 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:43:04.271941 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config.
May 14 04:43:04.272666 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:43:04.272973 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:04.273266 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:04.273729 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:04.274030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a2607d5-4254-4aaf-a682-3aae104d1507', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:43:04.274346 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:04.300662 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507 (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:04.303252 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '198')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507', '197')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8496b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:43:04.303252 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flush multipath device 3300000001bbb7a03 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:43:04.339027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:04.385114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:04.432789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:43:04.432789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:43:04.432789 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:43:04.450514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:43:04.450514 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:43:04.465868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.500433 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.40.100,3260]
May 14 04:43:04.500433 np0000000747 nova-compute[97971]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.40.100,3260] successful.
May 14 04:43:04.500433 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.514707 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.516708 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:04.527958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.559517 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.50.100,3260]
May 14 04:43:04.559517 np0000000747 nova-compute[97971]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3a2607d5-4254-4aaf-a682-3aae104d1507, portal: 192.168.50.100,3260] successful.
May 14 04:43:04.559517 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.575452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:04.575452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:04.575452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== disconnect_volume: return (299ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:04.575452 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:43:05.123978 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:05.844349 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Secret XML: <secret ephemeral="no" private="no">
May 14 04:43:05.844349 np0000000747 nova-compute[97971]:   <usage type="volume">
May 14 04:43:05.844349 np0000000747 nova-compute[97971]:     <volume>7e0493ba-3a5e-42f3-89fa-658ab8b6adc6</volume>
May 14 04:43:05.844349 np0000000747 nova-compute[97971]:   </usage>
May 14 04:43:05.844349 np0000000747 nova-compute[97971]: </secret>
May 14 04:43:05.844349 np0000000747 nova-compute[97971]:  {{(pid=97971) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 14 04:43:05.853480 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:06.131103 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fa962feb-d531-4243-a808-013c68fa5e14 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.038s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:06.160165 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:06.356814 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to attach volume 7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:06.359055 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <alias name="ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6"/>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <serial>7e0493ba-3a5e-42f3-89fa-658ab8b6adc6</serial>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="3db548ca-ce21-435e-9da5-0d9f6226b3cb"/>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:06.359055 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:06.520849 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:07.549288 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:07.549918 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:08.052564 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:08.657245 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003773970001930138 future=<Future at 0x7436183a3680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:08.657784 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] Emitting event <LifecycleEvent: 1778733773.656668, dee217de-fe65-44b9-8ef7-685eb8107b32 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:08.657908 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:08.658098 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] VM Stopped (Lifecycle Event)
May 14 04:43:09.031333 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:09.031459 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:09.031584 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:09.031709 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:09.031788 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:38:99:9f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:09.058974 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:09.160940 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-1677517f-84dc-453a-9296-5ff34d35cf3d tempest-TestEncryptedCinderVolumes-100611717 tempest-TestEncryptedCinderVolumes-100611717-project-member] [instance: dee217de-fe65-44b9-8ef7-685eb8107b32] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:09.202086 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:09.724276 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:10.115786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:10.115993 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:10.116198 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attaching volume df047195-c2fc-4250-b4ba-5bc2955002a4 to /dev/vdb
May 14 04:43:10.162385 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:10.174233 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:10.196153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:10.241337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:10.241705 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:10.251953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:10.254363 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:43:10.254526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:10.254669 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:10.254934 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:10.255185 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating existing volume attachment record: a3f1fea7-80c1-402a-a23d-2a14f3da3826 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:10.590584 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b71f690c-6684-4379-9b25-9784523b00eb tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.401s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:10.801810 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:10.802216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:10.802389 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:10.802857 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:10.803572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:10.818786 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:10.819422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:10.820040 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:10.820329 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:10.821051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:10.821051 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:10.832049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:10.832049 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:10.837174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:10.837174 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:10.844003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4] added
May 14 04:43:10.844003 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:10.844003 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:10.844003 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:10.844003 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:10.844003 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:10.844003 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:10.844254 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:10.844409 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:10.844569 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:10.848146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4] added
May 14 04:43:10.848146 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:10.848146 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:10.848146 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:10.848146 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:10.848146 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:10.848146 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:10.848329 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:10.848462 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:10.848635 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:11.171025 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:11.171374 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:11.291599 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:11.522281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:11.676991 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:11.844998 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:11.849060 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:11.858741 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:11.858741 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:11.861366 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:11.861366 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.872272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.877397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.887235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:11.893921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.893921 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.893921 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.893921 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.893921 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:11.894090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.894090 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.894090 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.894090 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.894090 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:11.922074 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.50.100,3260]
May 14 04:43:11.922074 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.50.100,3260] successful.
May 14 04:43:11.922074 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.930134 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.40.100,3260]
May 14 04:43:11.930134 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.40.100,3260] successful.
May 14 04:43:11.930134 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.935867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.942182 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.950057 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.950356 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:11.950532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:11.950650 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:11.951810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('9', '-', '-', 0) found on session 201 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:11.951929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.957903 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:11.958140 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:11.958258 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:11.958311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:11.958953 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('10', '-', '-', 0) found on session 202 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:11.959049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:11.967501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 201 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:11.967501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:11.975448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 202 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:11.975603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:12.572150 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:12.683362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:12.820313 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:13.076141 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:43:13.076141 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:43:13.076141 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Triggering sync for uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 14 04:43:13.076656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:13.078286 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:13.078518 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:13.078703 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:13.078844 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:13.079006 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.03 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:43:13.527800 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:13.584927 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:13.585466 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:13.752602 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:13.752813 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:13.753118 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attaching volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 to /dev/vdd
May 14 04:43:13.801494 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:13.812543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:13.839359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found WWN 3300000008fb52911 for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:13.839656 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:13.839826 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008fb52911', 'path': '/dev/dm-2', 'multipath_id': '3300000008fb52911'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:13.839936 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008fb52911', 'path': '/dev/dm-2', 'multipath_id': '3300000008fb52911'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:13.841662 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:13.862122 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:13.885779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:13.886020 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:13.896303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:13.897893 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:43:13.897893 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:13.897893 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:13.898061 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:13.898162 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating existing volume attachment record: 750fb9b9-1948-49fb-9b61-332baf13ffb6 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:14.203199 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:14.368251 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to attach volume df047195-c2fc-4250-b4ba-5bc2955002a4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:14.371111 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:   <alias name="ua-df047195-c2fc-4250-b4ba-5bc2955002a4"/>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:   <serial>df047195-c2fc-4250-b4ba-5bc2955002a4</serial>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:14.371111 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:14.462012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:14.462929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:14.463161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:14.463596 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:14.463856 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:14.476392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:14.476898 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:14.477288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:14.477487 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:14.477986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:14.478178 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:14.489739 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:14.489739 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:14.500383 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:14.500383 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461] added
May 14 04:43:14.508637 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:14.508637 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:14.508637 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:14.513158 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461] added
May 14 04:43:14.513158 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:14.513158 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:14.513158 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:14.513158 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:14.513158 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:14.513158 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:14.513348 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:14.513440 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:14.513596 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:15.121887 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:15.507688 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:15.513967 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:15.520374 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:15.520374 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:15.529644 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:15.529644 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.534984 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.544202 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.550232 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.550408 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.558126 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.558303 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:15.588237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.40.100,3260]
May 14 04:43:15.588237 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.40.100,3260] successful.
May 14 04:43:15.588237 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.593479 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.50.100,3260]
May 14 04:43:15.593479 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.50.100,3260] successful.
May 14 04:43:15.593479 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.601395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.607051 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.619406 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.619694 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:15.619845 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:15.619955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:15.620904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('13', '-', '-', 0) found on session 203 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:15.621015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.623308 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:15.623553 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:15.623783 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:15.623919 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:15.625059 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('14', '-', '-', 0) found on session 204 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:15.625103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:15.639194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 203 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:15.639430 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:15.648471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 204 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:15.648471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:16.030915 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:16.031078 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:16.031137 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:16.031248 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No VIF found with MAC fa:16:3e:d4:2f:bf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:16.478473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:16.524278 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:17.495406 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found WWN 3300000003de2e911 for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:17.495721 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:17.495868 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000003de2e911', 'path': '/dev/dm-3', 'multipath_id': '3300000003de2e911'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:17.495993 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003de2e911', 'path': '/dev/dm-3', 'multipath_id': '3300000003de2e911'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:17.498633 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:17.584489 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b99689cc-a990-4d98-945b-d005c30b864a tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.468s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:17.585526 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:18.001488 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to attach volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:18.002864 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <target dev="vdd" bus="virtio"/>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:18.002864 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:18.096194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:18.935969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:18.936334 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:19.219196 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:19.437676 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:43:19.654274 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:19.654396 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:19.654534 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:19.654661 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdd, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:19.654755 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:19.654847 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:38:99:9f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:19.988916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:19.989384 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:19.991895 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:43:19.992012 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Claim successful on node np0000000747
May 14 04:43:20.749101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:20.749101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:21.195558 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:43:21.196476 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:43:21.197674 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a423f9b0-9f22-435d-acb1-1c03c558b724 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.445s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:21.251239 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Detaching volume df047195-c2fc-4250-b4ba-5bc2955002a4
May 14 04:43:21.287356 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to driver detach volume df047195-c2fc-4250-b4ba-5bc2955002a4 from mountpoint /dev/vdb
May 14 04:43:21.291301 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-df047195-c2fc-4250-b4ba-5bc2955002a4 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:21.292681 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-df047195-c2fc-4250-b4ba-5bc2955002a4 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:21.292833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Attempting to detach device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:43:21.293134 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <alias name="ua-df047195-c2fc-4250-b4ba-5bc2955002a4"/>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <serial>df047195-c2fc-4250-b4ba-5bc2955002a4</serial>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:21.293134 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:21.298421 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config.
May 14 04:43:21.298569 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] (1/8): Attempting to detach device vdb with device alias ua-df047195-c2fc-4250-b4ba-5bc2955002a4 from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:43:21.298854 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <alias name="ua-df047195-c2fc-4250-b4ba-5bc2955002a4"/>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-2"/>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <serial>df047195-c2fc-4250-b4ba-5bc2955002a4</serial>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:21.298854 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:21.527821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:21.699193 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:43:21.741295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733801.7408416, 519e07c2-32c7-460a-a83a-b64248c1ee17 => ua-df047195-c2fc-4250-b4ba-5bc2955002a4> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:43:21.742074 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-df047195-c2fc-4250-b4ba-5bc2955002a4 for instance 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:43:21.744132 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config.
May 14 04:43:21.745081 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:43:21.745361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:21.745504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:21.745821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:21.746089 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df047195-c2fc-4250-b4ba-5bc2955002a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:43:21.746206 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:21.778137 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:21.778687 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:43:21.778687 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', '202')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:21.781270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4', '201')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:21.782098 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8328d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'): ({'sdd'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:43:21.782303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:43:21.782560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flush multipath device 3300000008fb52911 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:43:21.824025 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:21.869145 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:21.905041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:43:21.905221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:43:21.906146 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:43:21.916911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:43:21.917084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:43:21.928741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:21.969056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.40.100,3260]
May 14 04:43:21.969056 np0000000747 nova-compute[97971]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.40.100,3260] successful.
May 14 04:43:21.969056 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:21.985311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:21.999723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:22.036631 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.50.100,3260]
May 14 04:43:22.036631 np0000000747 nova-compute[97971]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-df047195-c2fc-4250-b4ba-5bc2955002a4, portal: 192.168.50.100,3260] successful.
May 14 04:43:22.036631 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:22.052140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:22.052315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:22.052435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== disconnect_volume: return (306ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:22.052544 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:43:22.205248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.216s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:22.205717 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:43:22.593552 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:22.710765 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:43:22.711500 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:43:22.711915 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:22.712241 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:22.799507 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0386f2a607ee4edda3d9a711ce02eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7eb6509a24d34807cf5fb11dcb7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:43:23.211941 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:43:23.223648 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Successfully created port: fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:43:23.597967 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:23.598245 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:23.604465 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-90bb0d22-c396-4521-89ba-60cc5b785f45 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.855s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:23.643328 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Successfully updated port: fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:43:23.688242 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-changed-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:23.688392 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Refreshing instance network info cache due to event network-changed-fe965eb0-c55d-4b0a-bba4-95a91a84e997. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:43:23.688568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] Acquiring lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:23.688691 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] Acquired lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:23.688981 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Refreshing network info cache for port fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:43:23.715343 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:43:24.102669 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:43:24.108946 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:24.109533 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:43:24.145265 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:24.190660 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:24.219633 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Booting with volume 612a1a18-bad1-4a2a-99e1-ed2bb21316f7 at /dev/vda
May 14 04:43:24.231853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:24.245086 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:43:24.261493 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:24.271738 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:24.290283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:24.333066 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:24.333298 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:24.340364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:24.341498 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:43:24.341655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:24.341806 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:24.342053 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:24.342292 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating existing volume attachment record: a1e17369-fe5b-494d-9d70-4f2f33d6cc22 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:24.367196 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:24.646890 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:24.647210 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:24.652654 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:43:24.652806 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Claim successful on node np0000000747
May 14 04:43:24.870137 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d84e39a-b9dc-496e-aad8-3a27cd60bc22 req-89b95f69-3eee-4bcb-a1e4-5b8e469ea152 service nova] Releasing lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:24.870568 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquired lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:24.870766 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:43:25.124547 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:25.124679 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:25.433081 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:43:25.563403 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:25.578661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:25.579041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:25.609905 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:25.610454 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:25.610731 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:25.627724 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:25.678015 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating instance_info_cache with network_info: [{"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:25.888211 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:43:25.888454 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:43:26.081860 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:26.114533 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:26.179883 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Releasing lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:26.180219 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance network_info: |[{"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:43:26.390971 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:43:26.427719 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:43:26.428703 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:43:26.428951 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Creating image(s)
May 14 04:43:26.429311 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:43:26.429496 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Ensure instance console log exists: /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:43:26.429766 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:26.429980 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:26.430124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:26.430659 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Start _get_guest_xml network_info=[{"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1e17369-fe5b-494d-9d70-4f2f33d6cc22', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cff8c6a7-d5e1-4115-8690-25399c05f1f8', 'attached_at': '', 'detached_at': '', 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'serial': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:43:26.433094 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:43:26.434167 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1301668444', uuid='cff8c6a7-d5e1-4115-8690-25399c05f1f8'), owner=OwnerMeta(userid='0386f2a607ee4edda3d9a711ce02eeee', username='tempest-TestVolumeBootPatternV346-645608592-project-member', projectid='cce7eb6509a24d34807cf5fb11dcb7ba', projectname='tempest-TestVolumeBootPatternV346-645608592'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733806.4338682) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:43:26.435302 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:43:26.435640 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:43:26.436752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:43:26.436956 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:43:26.437961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:43:26.438257 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:43:26.438465 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:43:26.438606 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:43:26.438800 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:43:26.438936 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:43:26.439077 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:43:26.439290 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:43:26.439444 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:43:26.439609 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:43:26.439787 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:43:26.439956 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:43:26.453063 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:26.453495 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:26.453692 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:26.454102 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:26.454387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:26.466257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:26.466918 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:26.468039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:26.468264 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:26.468894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:26.469645 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:26.481760 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:26.481760 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:26.486663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:26.486663 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:26.492911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7] added
May 14 04:43:26.492911 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:26.492911 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:26.492911 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:26.492911 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:26.492911 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:26.492911 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:26.493137 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:26.493278 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:26.493498 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:26.497419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7] added
May 14 04:43:26.497419 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:26.497419 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:26.497419 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:26.497419 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:26.497419 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:26.497419 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:26.497605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:26.497711 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:26.497844 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:26.528377 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:26.632787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:26.897707 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.250s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:26.898293 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.783s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:26.898567 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:43:26.900481 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:26.900690 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:43:27.086261 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:27.404026 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:43:27.404178 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:43:27.404466 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:27.404673 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:27.466183 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '727fba2b300b4d4596102544c1a6d398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9942017b2e7541a3971a106d228bd9d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:43:27.493892 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:27.498673 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:27.505734 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:27.505734 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:27.510914 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:27.510914 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.517512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.523110 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.534676 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.534937 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.536125 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.536359 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:27.566954 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.40.100,3260]
May 14 04:43:27.566954 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.40.100,3260] successful.
May 14 04:43:27.566954 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.574770 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.50.100,3260]
May 14 04:43:27.574770 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.50.100,3260] successful.
May 14 04:43:27.574770 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.580135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.586087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.596131 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.596932 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:27.596932 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:27.597230 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:27.598019 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('9', '-', '-', 0) found on session 205 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:27.598115 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.603982 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:27.604154 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:27.604412 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:27.604532 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:27.605401 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('10', '-', '-', 0) found on session 206 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:27.605643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:27.611732 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 205 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:27.611859 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:27.620535 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 206 and hctl ['10', '*', '*', 0] yield: sde {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:27.620535 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:27.683050 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:27.683661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:27.684286 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attaching volume 7a12f71d-53a3-47f9-8089-0e36c2df55ec to /dev/vdb
May 14 04:43:27.729117 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:27.740934 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:27.766965 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:27.818908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:27.819227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:27.829540 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:27.830899 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:43:27.831065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:27.831212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:27.831537 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:27.831861 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating existing volume attachment record: 359f1c99-3dc4-4ed3-8265-3b1f9f77b092 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:27.906847 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:43:27.925349 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:27.950753 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Successfully created port: ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:43:28.030041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.030457 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.112473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.116657 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.155895 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:28.156171 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:28.156532 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attaching volume 433fa717-09d4-4e1b-8175-6935dc60721a to /dev/vdb
May 14 04:43:28.202958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.204167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.205064 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:28.220315 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:28.238516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.279911 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:28.280172 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:28.288282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:28.289276 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b'] 
May 14 04:43:28.289396 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:28.289505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:28.289738 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:28.289969 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating existing volume attachment record: 9ef1bac3-19b2-49fa-bb25-2651a881e385 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:28.293356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.297851 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.368794 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Successfully updated port: ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:43:28.385849 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:28.386431 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:28.386772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:28.395982 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.396339 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.412487 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:43:28.420575 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-changed-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:28.421482 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Refreshing instance network info cache due to event network-changed-ca4f227a-13af-456e-b49b-743aa0a0ba1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:43:28.421482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] Acquiring lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:28.421482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] Acquired lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:28.421752 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Refreshing network info cache for port ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:43:28.468981 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:28.483101 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.483444 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:43:28.483560 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:43:28.483713 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vdd) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:43:28.487174 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:43:28.488053 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:28.533730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:28.534068 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13090MB free_disk=72.57099533081055GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:43:28.534258 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:28.534540 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:28.831658 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:28.831945 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:28.832086 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:28.872044 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:28.924960 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:28.977248 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:43:29.086923 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:29.234283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:29.428244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:43:29.429289 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:43:29.429551 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Creating image(s)
May 14 04:43:29.430007 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:29.430155 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:29.430567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:29.431919 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:43:29.434257 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:43:29.435114 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:29.484909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Found WWN 3300000004305324c for multipath device dm-2 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:29.485943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:29.485943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000004305324c', 'path': '/dev/dm-2', 'multipath_id': '3300000004305324c'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:29.485943 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004305324c', 'path': '/dev/dm-2', 'multipath_id': '3300000004305324c'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:29.486698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.100s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:29.486956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:29.500027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:29.500594 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:29.501084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:29.501365 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:29.501894 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:29.502686 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:29.515791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:29.515791 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:29.520551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:29.520551 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:29.529364 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec] added
May 14 04:43:29.529364 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:29.529364 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:29.529364 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:29.529364 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:29.529364 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:29.529364 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:29.529522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:29.529704 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:29.529846 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:29.532058 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec] added
May 14 04:43:29.532058 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:29.532058 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:29.532058 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:29.532058 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:29.532058 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:29.532058 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:29.532222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:29.532387 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:29.532532 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:29.534781 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.100s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:29.535179 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:29.535484 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:29.535970 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:43:29.539438 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:43:29.540055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:29.588726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-5fc7f73a-4bc5-4d81-b5cd-a168e1feb64c req-d364a1ed-d0d8-48d8-b1d9-13103c905090 service nova] Releasing lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:29.589468 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquired lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:29.589468 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:43:29.598322 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 519e07c2-32c7-460a-a83a-b64248c1ee17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:43:29.598462 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:43:29.598596 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:43:29.598720 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance cff8c6a7-d5e1-4115-8690-25399c05f1f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:43:29.598836 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 98b0ed19-4498-4df3-865d-f3c3052158da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:43:29.599017 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:43:29.599152 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:43:28 up 43 min,  2 users,  load average: 3.84, 5.62, 5.18\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_8b15f4dfd4464a55b9bf21c4b7dec307': '1', 'io_workload': '2', 'num_proj_9942017b2e7541a3971a106d228bd9d6': '2', 'num_proj_86b003b259594616b507a7789de64b6f': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_cce7eb6509a24d34807cf5fb11dcb7ba': '1', 'num_task_block_device_mapping': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:43:29.626207 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.086s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:29.626919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:29.680410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk 1073741824" returned: 0 in 0.053s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:29.680797 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:29.681078 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:29.785759 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.104s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:29.786495 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:43:29.786495 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:29.879919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:29.880288 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Cannot resize image /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:43:29.880636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:43:29.880831 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Ensure instance console log exists: /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:43:29.881104 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:29.881328 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:29.881455 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:29.884170 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:43:29.884445 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:43:29.994827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1301668444',display_name='tempest-TestVolumeBootPatternV346-server-1301668444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1301668444',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPe583jmKB8ykHpSlLlmxU2AM97pkfgVXLlpOGrzYZq/RyuWPsD2pUKkOLC8l6F6HrHV76s4Ir2SJrFODmrvMqufXTJUkEizpeCRiSZkorJXjTF7xb78k+CLg6ep7UIIg==',key_name='tempest-keypair-491463117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-4jppdt4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=cff8c6a7-d5e1-4115-8690-25399c05f1f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:43:29.995029 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:43:29.995628 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:43:29.996940 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'pci_devices' on Instance uuid cff8c6a7-d5e1-4115-8690-25399c05f1f8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:30.145248 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:43:30.275801 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:30.381065 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating instance_info_cache with network_info: [{"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:30.387763 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:43:30.499808 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] End _get_guest_xml xml=<domain type="qemu">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <uuid>cff8c6a7-d5e1-4115-8690-25399c05f1f8</uuid>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <name>instance-0000004c</name>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1301668444</nova:name>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:43:26</nova:creationTime>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:user uuid="0386f2a607ee4edda3d9a711ce02eeee">tempest-TestVolumeBootPatternV346-645608592-project-member</nova:user>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:project uuid="cce7eb6509a24d34807cf5fb11dcb7ba">tempest-TestVolumeBootPatternV346-645608592</nova:project>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         <nova:port uuid="fe965eb0-c55d-4b0a-bba4-95a91a84e997">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <system>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="serial">cff8c6a7-d5e1-4115-8690-25399c05f1f8</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="uuid">cff8c6a7-d5e1-4115-8690-25399c05f1f8</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </system>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <os>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </os>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <features>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </features>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   <devices>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/disk.config"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </disk>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <alias name="ua-612a1a18-bad1-4a2a-99e1-ed2bb21316f7"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-2"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <serial>612a1a18-bad1-4a2a-99e1-ed2bb21316f7</serial>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </disk>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:c5:0e:72"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <target dev="tapfe965eb0-c5"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </interface>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/console.log" append="off"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </serial>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <video>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </video>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </rng>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:   </devices>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]: </domain>
May 14 04:43:30.499808 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Preparing to wait for external event network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1301668444',display_name='tempest-TestVolumeBootPatternV346-server-1301668444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1301668444',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPe583jmKB8ykHpSlLlmxU2AM97pkfgVXLlpOGrzYZq/RyuWPsD2pUKkOLC8l6F6HrHV76s4Ir2SJrFODmrvMqufXTJUkEizpeCRiSZkorJXjTF7xb78k+CLg6ep7UIIg==',key_name='tempest-keypair-491463117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-4jppdt4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=cff8c6a7-d5e1-4115-8690-25399c05f1f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:43:30.502089 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:43:30.502548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.502869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:30.503151 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:43:30.503879 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.504012 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '833e2809-03f1-5820-b859-4cfe8cf347b8', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:30.504763 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.505390 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:30.505635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.507422 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.507526 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe965eb0-c5, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:30.507793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe965eb0-c5, col_values=(('qos', UUID('ab4d0b4e-56f5-4012-827e-7c16b0e137d5')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:30.507940 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe965eb0-c5, col_values=(('external_ids', {'iface-id': 'fe965eb0-c55d-4b0a-bba4-95a91a84e997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:0e:72', 'vm-uuid': 'cff8c6a7-d5e1-4115-8690-25399c05f1f8'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:30.508548 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.509500 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:30.513788 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:30.514384 np0000000747 nova-compute[97971]: INFO os_vif [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5')
May 14 04:43:30.530355 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:30.532851 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:30.542630 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:30.542630 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:30.547321 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:30.547321 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.554629 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.559103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.570470 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.570712 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.575171 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.575355 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:30.611884 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.40.100,3260]
May 14 04:43:30.611884 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.40.100,3260] successful.
May 14 04:43:30.611884 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.619034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.50.100,3260]
May 14 04:43:30.619034 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.50.100,3260] successful.
May 14 04:43:30.619034 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.624168 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.630248 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.640684 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.640966 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:30.641147 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:30.641213 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:30.642174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('15', '-', '-', 0) found on session 207 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:30.642278 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.646634 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:30.646871 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:30.647063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:30.647063 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:30.647835 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] HCTL ('16', '-', '-', 0) found on session 208 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:30.647927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:30.656766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 207 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:30.656766 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:30.662283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Searching for a device in session 208 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:30.662283 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:30.883082 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Releasing lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:30.883354 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance network_info: |[{"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:43:30.885020 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Start _get_guest_xml network_info=[{"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:43:30.888502 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:43:30.890058 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1679916146', uuid='98b0ed19-4498-4df3-865d-f3c3052158da'), owner=OwnerMeta(userid='727fba2b300b4d4596102544c1a6d398', username='tempest-VolumeMultiattachTests-2142682089-project-member', projectid='9942017b2e7541a3971a106d228bd9d6', projectname='tempest-VolumeMultiattachTests-2142682089'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733810.8893826) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:43:30.891071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:43:30.891480 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:43:30.892430 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:43:30.892599 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:43:30.893525 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:43:30.893851 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:43:30.894014 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:43:30.894112 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:43:30.894244 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:43:30.894382 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:43:30.894520 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:43:30.895679 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:43:30.895943 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:43:30.896116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.361s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:30.896274 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:43:30.896645 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:43:30.896777 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:43:30.896906 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:43:30.897053 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:43:30.915366 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1679916146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1679916146',id=77,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-ed8yat40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=98b0ed19-4498-4df3-865d-f3c3052158da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:43:30.915366 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:43:30.915850 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:43:30.916336 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'pci_devices' on Instance uuid 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:31.418868 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] End _get_guest_xml xml=<domain type="qemu">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <uuid>98b0ed19-4498-4df3-865d-f3c3052158da</uuid>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <name>instance-0000004d</name>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumeMultiattachTests-server-1679916146</nova:name>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:43:30</nova:creationTime>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:user uuid="727fba2b300b4d4596102544c1a6d398">tempest-VolumeMultiattachTests-2142682089-project-member</nova:user>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:project uuid="9942017b2e7541a3971a106d228bd9d6">tempest-VolumeMultiattachTests-2142682089</nova:project>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         <nova:port uuid="ca4f227a-13af-456e-b49b-743aa0a0ba1b">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <system>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="serial">98b0ed19-4498-4df3-865d-f3c3052158da</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="uuid">98b0ed19-4498-4df3-865d-f3c3052158da</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </system>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <os>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </os>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <features>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </features>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   <devices>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </disk>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.config"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </disk>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ea:34:d7"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <target dev="tapca4f227a-13"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </interface>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/console.log" append="off"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </serial>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <video>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </video>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </rng>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:   </devices>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]: </domain>
May 14 04:43:31.418868 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Preparing to wait for external event network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1679916146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1679916146',id=77,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-ed8yat40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=98b0ed19-4498-4df3-865d-f3c3052158da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:43:31.420684 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:43:31.421052 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:43:31.421268 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:43:31.421600 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.421899 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:31.422134 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:43:31.422795 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.422983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffdf1c1e-67d5-567c-aed7-cc8bc1e53815', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:31.423750 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.424336 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:31.429040 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.430765 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.430944 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4f227a-13, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:31.431258 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca4f227a-13, col_values=(('qos', UUID('cbf37fb1-130a-4269-8c3f-8e6ad57f1ea8')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:31.431451 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca4f227a-13, col_values=(('external_ids', {'iface-id': 'ca4f227a-13af-456e-b49b-743aa0a0ba1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:34:d7', 'vm-uuid': '98b0ed19-4498-4df3-865d-f3c3052158da'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:31.432123 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.433190 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:31.440724 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:31.441485 np0000000747 nova-compute[97971]: INFO os_vif [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13')
May 14 04:43:31.503174 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:31.529202 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:32.028223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:32.028401 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:32.028531 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No VIF found with MAC fa:16:3e:c5:0e:72, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:32.028994 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Using config drive
May 14 04:43:32.522014 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found WWN 330000000cb6d805f for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:32.522424 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:32.522501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== connect_volume: return (4135ms) {'type': 'block', 'scsi_wwn': '330000000cb6d805f', 'path': '/dev/dm-6', 'multipath_id': '330000000cb6d805f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:32.522704 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cb6d805f', 'path': '/dev/dm-6', 'multipath_id': '330000000cb6d805f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:32.523483 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.691s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:32.523744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:32.525526 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:32.538070 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:32.541489 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:32.542270 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:32.542695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:32.543088 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:32.543459 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:32.543630 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:32.554584 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:32.554584 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:32.558886 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:32.558886 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:32.565363 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a] added
May 14 04:43:32.565363 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:32.565363 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:32.565363 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:32.565363 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:32.565363 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:32.565363 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:32.565539 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:32.565723 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:32.565887 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:32.569402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a] added
May 14 04:43:32.569402 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:32.569402 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:32.569402 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:32.569402 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:32.569402 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:32.569402 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:32.569563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:32.569697 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:32.569811 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:32.664936 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Creating config drive at /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/disk.config
May 14 04:43:32.668661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7786dsjc {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:32.721430 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7786dsjc" returned: 0 in 0.052s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:32.958071 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:32.958222 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:32.958305 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:ea:34:d7, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:32.958870 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Using config drive
May 14 04:43:33.028355 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to attach volume 7a12f71d-53a3-47f9-8089-0e36c2df55ec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:33.030189 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:   <alias name="ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec"/>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:   <serial>7a12f71d-53a3-47f9-8089-0e36c2df55ec</serial>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:33.030189 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:33.098143 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.122789 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.124275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.271390 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-52fd5148-723a-482a-b43b-270175560590 req-da8accdd-de7c-49a9-85d8-1bd98675ad7a service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:33.271625 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52fd5148-723a-482a-b43b-270175560590 req-da8accdd-de7c-49a9-85d8-1bd98675ad7a service nova] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:33.271798 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52fd5148-723a-482a-b43b-270175560590 req-da8accdd-de7c-49a9-85d8-1bd98675ad7a service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:33.271924 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-52fd5148-723a-482a-b43b-270175560590 req-da8accdd-de7c-49a9-85d8-1bd98675ad7a service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:33.272052 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-52fd5148-723a-482a-b43b-270175560590 req-da8accdd-de7c-49a9-85d8-1bd98675ad7a service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Processing event network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:43:33.317109 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.403262 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.411844 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.414434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.433210 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.439424 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:33.470752 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:33.566344 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:33.570514 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:33.579428 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:33.579428 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:33.586316 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:33.586316 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.589826 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Creating config drive at /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.config
May 14 04:43:33.594065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2cjorkgn {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:33.594318 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.607109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.612544 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.612832 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.623667 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.623910 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:33.653572 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2cjorkgn" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:43:33.654257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.40.100,3260]
May 14 04:43:33.654257 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.40.100,3260] successful.
May 14 04:43:33.654257 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.666052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.675148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.50.100,3260]
May 14 04:43:33.675148 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.50.100,3260] successful.
May 14 04:43:33.675148 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.683515 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.683899 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:33.684217 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:33.684282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:33.685367 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] HCTL ('17', '-', '-', 0) found on session 209 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:33.685590 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:33.688458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:33.703332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching for a device in session 209 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:33.703332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.713937 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:33.714351 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:33.714747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:33.714747 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:33.715947 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] HCTL ('18', '-', '-', 0) found on session 210 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:33.716093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:33.730154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching for a device in session 210 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:33.730154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:33.928744 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733813.9282277, cff8c6a7-d5e1-4115-8690-25399c05f1f8 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:33.929333 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:43:33.929561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] VM Started (Lifecycle Event)
May 14 04:43:33.933373 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:43:33.938683 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance spawned successfully.
May 14 04:43:33.938998 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:43:34.067588 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:34.088907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:34.184029 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:34.199089 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:34.234318 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d0d7f897-07c4-44b6-bd29-3e4ad310be12 req-57aa1c76-020f-4c50-adf1-2493daca7c20 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:34.234675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d0d7f897-07c4-44b6-bd29-3e4ad310be12 req-57aa1c76-020f-4c50-adf1-2493daca7c20 service nova] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:34.234902 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d0d7f897-07c4-44b6-bd29-3e4ad310be12 req-57aa1c76-020f-4c50-adf1-2493daca7c20 service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:34.235054 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d0d7f897-07c4-44b6-bd29-3e4ad310be12 req-57aa1c76-020f-4c50-adf1-2493daca7c20 service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:34.235496 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d0d7f897-07c4-44b6-bd29-3e4ad310be12 req-57aa1c76-020f-4c50-adf1-2493daca7c20 service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Processing event network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:43:34.432495 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:34.438852 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:43:34.445339 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.445456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.445808 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.446045 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.446263 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.446507 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:34.544643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:34.745344 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:34.745740 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:34.745740 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:34.745740 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] No VIF found with MAC fa:16:3e:d4:2f:bf, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:34.799971 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:43:34.801870 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:43:34.803868 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance spawned successfully.
May 14 04:43:34.804112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:43:34.895782 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:34.896488 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:34.897721 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:34.897841 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:43:34.898093 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.71 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:43:34.940871 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:43:34.940871 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733814.9398496, cff8c6a7-d5e1-4115-8690-25399c05f1f8 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:34.940871 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] VM Paused (Lifecycle Event)
May 14 04:43:34.952107 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Took 8.52 seconds to spawn the instance on the hypervisor.
May 14 04:43:34.952589 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:35.311006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.311151 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.311457 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.311680 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.311934 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.312207 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:43:35.339638 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:35.341886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:35.341886 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:35.342324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:35.342410 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] No waiting events found dispatching network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:43:35.343473 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-561e2ffa-2f0e-4377-b813-c55c6e12ca1e req-fc97698a-30fa-4c9b-ad2f-4d8c53a8862a service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received unexpected event network-vif-plugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 for instance with vm_state active and task_state None.
May 14 04:43:35.443118 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:35.444692 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733815.4444637, cff8c6a7-d5e1-4115-8690-25399c05f1f8 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:35.444954 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] VM Resumed (Lifecycle Event)
May 14 04:43:35.460362 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Took 15.52 seconds to build instance.
May 14 04:43:35.564006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found WWN 33000000069addc76 for multipath device dm-7 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:35.564300 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:35.564468 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== connect_volume: return (6732ms) {'type': 'block', 'scsi_wwn': '33000000069addc76', 'path': '/dev/dm-7', 'multipath_id': '33000000069addc76'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:35.564597 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069addc76', 'path': '/dev/dm-7', 'multipath_id': '33000000069addc76'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:35.567323 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:35.612388 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:43:35.613427 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:43:35.821387 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Took 6.39 seconds to spawn the instance on the hypervisor.
May 14 04:43:35.821938 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:35.947525 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:35.950549 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:43:35.961916 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b8c4fa0f-a0cd-4fe7-a0c5-682ffb06d9a1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.026s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:36.069974 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attempting to attach volume 433fa717-09d4-4e1b-8175-6935dc60721a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:36.072930 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:   <alias name="ua-433fa717-09d4-4e1b-8175-6935dc60721a"/>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:   <serial>433fa717-09d4-4e1b-8175-6935dc60721a</serial>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:36.072930 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:36.299327 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e3bd6092-0339-44c8-9876-9e2a0b967c5d tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.616s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:36.304652 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:36.305656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:36.308091 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:36.308091 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:36.308091 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] No waiting events found dispatching network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:43:36.308091 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ceef46b6-0743-4925-be69-20cc3fb099f7 req-6d94b090-4f57-4de8-9c8e-00c4a44d855f service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received unexpected event network-vif-plugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b for instance with vm_state active and task_state None.
May 14 04:43:36.330064 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Took 11.72 seconds to build instance.
May 14 04:43:36.432970 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:36.451742 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733816.4513628, 98b0ed19-4498-4df3-865d-f3c3052158da => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:36.452887 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] VM Started (Lifecycle Event)
May 14 04:43:36.531743 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:36.831206 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.233s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:36.955385 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:36.958035 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:43:37.403208 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-changed-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:37.403731 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Refreshing instance network info cache due to event network-changed-fe965eb0-c55d-4b0a-bba4-95a91a84e997. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:43:37.403731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] Acquiring lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:37.403731 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] Acquired lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:37.403731 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Refreshing network info cache for port fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:43:37.460843 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733817.4605048, 98b0ed19-4498-4df3-865d-f3c3052158da => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:37.461041 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] VM Paused (Lifecycle Event)
May 14 04:43:37.759732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:37.759732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:37.759732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:37.759732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No VIF found with MAC fa:16:3e:d2:39:f1, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:37.907002 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:37.963408 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:37.968210 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733817.967967, 98b0ed19-4498-4df3-865d-f3c3052158da => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:43:37.968481 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] VM Resumed (Lifecycle Event)
May 14 04:43:38.195378 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:38.334088 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updated VIF entry in instance network info cache for port fe965eb0-c55d-4b0a-bba4-95a91a84e997. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:43:38.334492 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating instance_info_cache with network_info: [{"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:38.376101 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:38.376274 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing instance network info cache due to event network-changed-5c622dea-fc9d-4780-a6d2-fad9c4f037bd. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:43:38.376364 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Acquiring lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:38.376455 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Acquired lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:38.376551 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Refreshing network info cache for port 5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:43:38.473038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:43:38.474910 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:43:38.837604 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6cbf0b2e-ce75-40ad-86c0-b13d67317367 req-46067d17-dac9-417d-aac0-78c196d77c15 service nova] Releasing lock "refresh_cache-cff8c6a7-d5e1-4115-8690-25399c05f1f8" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:38.879409 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:39.133570 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:39.257056 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updated VIF entry in instance network info cache for port 5c622dea-fc9d-4780-a6d2-fad9c4f037bd. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:43:39.257393 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [{"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:39.302885 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9476782d-5587-45d2-b3fb-0f811e03e3c8 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.147s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:39.759361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Releasing lock "refresh_cache-5aaaf66c-6055-4f5a-add8-fb3bbe588f87" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:39.759520 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-changed-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:39.759625 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Refreshing instance network info cache due to event network-changed-ca4f227a-13af-456e-b49b-743aa0a0ba1b. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:43:39.759784 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Acquiring lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:43:39.759958 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Acquired lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:43:39.759958 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Refreshing network info cache for port ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:43:39.857919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:39.857919 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:40.262906 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:40.361534 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Detaching volume 7a12f71d-53a3-47f9-8089-0e36c2df55ec
May 14 04:43:40.413895 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Attempting to driver detach volume 7a12f71d-53a3-47f9-8089-0e36c2df55ec from mountpoint /dev/vdb
May 14 04:43:40.426204 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:40.429120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Found disk vdb by alias ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:40.429120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Attempting to detach device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:43:40.429120 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <alias name="ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec"/>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <serial>7a12f71d-53a3-47f9-8089-0e36c2df55ec</serial>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:40.429120 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:40.435882 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the persistent domain config.
May 14 04:43:40.435994 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] (1/8): Attempting to detach device vdb with device alias ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:43:40.436207 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <alias name="ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec"/>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <serial>7a12f71d-53a3-47f9-8089-0e36c2df55ec</serial>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:40.436207 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:40.602637 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:40.732399 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updated VIF entry in instance network info cache for port ca4f227a-13af-456e-b49b-743aa0a0ba1b. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:43:40.732972 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating instance_info_cache with network_info: [{"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:40.928908 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733820.9285796, 519e07c2-32c7-460a-a83a-b64248c1ee17 => ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:43:40.929649 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7a12f71d-53a3-47f9-8089-0e36c2df55ec for instance 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:43:40.931559 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully detached device vdb from instance 519e07c2-32c7-460a-a83a-b64248c1ee17 from the live domain config.
May 14 04:43:40.932520 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:43:40.932837 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:40.932996 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:40.933354 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:40.933681 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a12f71d-53a3-47f9-8089-0e36c2df55ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:43:40.933867 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:40.965490 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:40.965943 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:40.965943 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '210')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:43:40.966460 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', '207')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:40.967241 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec', '208')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:40.968407 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618389bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'): ({'sdk'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:43:40.968610 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:43:40.968946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Flush multipath device 330000000cb6d805f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:43:41.000049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:41.051170 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:41.086958 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:43:41.087140 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:43:41.088993 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:43:41.101740 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:43:41.101971 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:43:41.115895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.150683 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.40.100,3260]
May 14 04:43:41.150683 np0000000747 nova-compute[97971]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.40.100,3260] successful.
May 14 04:43:41.150683 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.174554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.188471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.223049 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.50.100,3260]
May 14 04:43:41.223049 np0000000747 nova-compute[97971]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-7a12f71d-53a3-47f9-8089-0e36c2df55ec, portal: 192.168.50.100,3260] successful.
May 14 04:43:41.223049 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.236602 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-51096a81-6c7a-49bc-bbdb-9f35462493d1 req-fc9402fc-4c40-4601-ac97-af1d186b1dfd service nova] Releasing lock "refresh_cache-98b0ed19-4498-4df3-865d-f3c3052158da" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:43:41.242352 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:41.242564 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:41.242697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] <== disconnect_volume: return (310ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:41.242811 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:43:41.434705 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:41.533131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:41.746434 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:41.746610 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:41.782805 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'flavor' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:42.249886 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:42.788490 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0e2d2b9e-d88e-4a97-a330-07d983212610 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.932s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:43.255110 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:44.329153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:44.329711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:44.329711 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attaching volume e02a2a1a-6766-4e5f-a139-86f6c7e7381f to /dev/vdc
May 14 04:43:44.372335 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:44.389164 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:43:44.410832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:43:44.456607 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:43:44.456887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:43:44.465960 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:43:44.467676 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fed4:2fbf', 'fe80::387c:26ff:fef2:18f3', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fed2:39f1', 'fe80::500b:51ff:fee8:7d5b', 'fe80::fc16:3eff:fec5:e72', 'fe80::a495:1eff:fe1e:d316', 'fe80::fc16:3eff:feea:34d7'] 
May 14 04:43:44.467863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:43:44.468011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:43:44.468334 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:44.468678 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating existing volume attachment record: 62e69bf5-3860-4b41-a622-b36eeff72239 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:43:45.017904 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:43:45.018277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:45.018435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:45.018876 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:45.019064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:43:45.030269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:45.030909 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:45.031269 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:45.031467 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:45.031842 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:45.032062 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:45.043044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:45.043044 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:45.048085 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:43:45.048085 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:45.055122 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f] added
May 14 04:43:45.055122 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:45.055122 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:45.055122 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:45.055122 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:45.055122 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:45.055122 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:45.055384 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:45.055588 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:45.055809 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:45.058906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f] added
May 14 04:43:45.058906 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:43:45.058906 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:45.058906 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:45.058906 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:43:45.058906 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:43:45.058906 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:45.059056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:43:45.059247 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:43:45.059386 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:43:46.056274 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:43:46.059790 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:46.068941 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:46.068941 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:43:46.074394 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:43:46.074394 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.082791 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.087643 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.099343 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.099603 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.103927 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.104225 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:46.145841 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.40.100,3260]
May 14 04:43:46.145841 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.40.100,3260] successful.
May 14 04:43:46.145841 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.154951 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.50.100,3260]
May 14 04:43:46.154951 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.50.100,3260] successful.
May 14 04:43:46.154951 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.159704 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.166928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.184018 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.184506 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:46.184774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:46.184774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.185135 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:46.185434 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:46.185709 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:46.185754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:43:46.187757 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] HCTL ('15', '-', '-', 0) found on session 211 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:46.187924 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:46.188200 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] HCTL ('16', '-', '-', 0) found on session 212 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:43:46.188544 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:43:46.206796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching for a device in session 212 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:46.206796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:46.206796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Searching for a device in session 211 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:43:46.206796 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:43:46.435836 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:46.535181 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:47.033171 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:43:48.049655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found WWN 330000000d6ebbf82 for multipath device dm-6 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:43:48.050042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:48.050042 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000d6ebbf82', 'path': '/dev/dm-6', 'multipath_id': '330000000d6ebbf82'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:48.050121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d6ebbf82', 'path': '/dev/dm-6', 'multipath_id': '330000000d6ebbf82'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:43:48.053070 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:48.556227 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attempting to attach volume e02a2a1a-6766-4e5f-a139-86f6c7e7381f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:43:48.557556 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:   <alias name="ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f"/>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:   <serial>e02a2a1a-6766-4e5f-a139-86f6c7e7381f</serial>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:48.557556 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:43:50.205286 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:50.205777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:50.205777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name vdc, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:50.205777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:43:50.205777 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] No VIF found with MAC fa:16:3e:d2:39:f1, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:43:50.905840 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:50.906006 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:50.906198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:50.906335 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:50.906437 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:50.908484 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Terminating instance
May 14 04:43:51.411386 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:43:51.430697 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.435051 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.436429 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.456076 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.458686 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.480890 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.536805 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.571927 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:51.574108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:51.574108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:51.574221 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:51.574358 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] No waiting events found dispatching network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:43:51.574516 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2dd01927-46ef-4c79-ab46-37e706e8d4a3 req-eba0f87f-34ce-4a43-8e8f-59aae2d770c7 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:43:51.704834 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.711483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:51.741830 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99963389100003 future=<Future at 0x74361828ab40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:51.744258 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.997379405000174 future=<Future at 0x74361828ab40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:51.744761 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99666464100028 future=<Future at 0x74361828ab40 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:51.745595 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Instance destroyed successfully.
May 14 04:43:51.746414 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lazy-loading 'resources' on Instance uuid 519e07c2-32c7-460a-a83a-b64248c1ee17 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:51.758427 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-570cf69b-c7a8-4957-a86d-4651863b9189 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.429s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:52.238779 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:52.238939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:52.248776 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-378455957',display_name='tempest-SnapshotDataIntegrityTests-server-378455957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-snapshotdataintegritytests-server-378455957',id=72,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeT3oLtxiSXyXfwDkTImge5O5+DuzhMXBunIG0LxvQ4aWybYVjc20+NQGWAdrahtmU21OvV5Qm5ZTP2SjYG+R51O7N9I2FyrvYF6oda++VPmR9XXGXMD+UqNHZ3+5MNBw==',key_name='tempest-keypair-195804693',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:41:46Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b15f4dfd4464a55b9bf21c4b7dec307',ramdisk_id='',reservation_id='r-i1d05f7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1275007703',owner_user_name='tempest-SnapshotDataIntegrityTests-1275007703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:41:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47f1acd1668e4ac08d6c058a60634819',uuid=519e07c2-32c7-460a-a83a-b64248c1ee17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:43:52.248954 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converting VIF {"id": "58724711-d912-40ab-a6e4-ff84d75187f1", "address": "fa:16:3e:d4:2f:bf", "network": {"id": "c61d7824-6d50-4259-8b09-e8e4b897db02", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1614049607-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b15f4dfd4464a55b9bf21c4b7dec307", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58724711-d9", "ovs_interfaceid": "58724711-d912-40ab-a6e4-ff84d75187f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:43:52.249522 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:43:52.249756 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:43:52.251680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.251680 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58724711-d9, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:52.252317 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.253235 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:52.253880 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.254520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.254520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c354b7db-37ef-4a4a-b04c-f6503af70e4b) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:43:52.255212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.255212 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:43:52.255564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:52.257186 np0000000747 nova-compute[97971]: INFO os_vif [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=58724711-d912-40ab-a6e4-ff84d75187f1,network=Network(c61d7824-6d50-4259-8b09-e8e4b897db02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58724711-d9')
May 14 04:43:52.257439 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Deleting instance files /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17_del
May 14 04:43:52.258183 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Deletion of /opt/stack/data/nova/instances/519e07c2-32c7-460a-a83a-b64248c1ee17_del complete
May 14 04:43:52.741297 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Detaching volume e02a2a1a-6766-4e5f-a139-86f6c7e7381f
May 14 04:43:52.764091 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 04:43:52.764763 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:43:52.765038 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:43:52.765150 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:43:52.765409 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:52.776397 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attempting to driver detach volume e02a2a1a-6766-4e5f-a139-86f6c7e7381f from mountpoint /dev/vdc
May 14 04:43:52.780523 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found disk vdc by alias ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:52.781679 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found disk vdc by alias ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:52.781802 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Attempting to detach device vdc from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:43:52.782017 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <alias name="ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f"/>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <serial>e02a2a1a-6766-4e5f-a139-86f6c7e7381f</serial>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:52.782017 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:52.787580 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully detached device vdc from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the persistent domain config.
May 14 04:43:52.787713 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] (1/8): Attempting to detach device vdc with device alias ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:43:52.787941 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <alias name="ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f"/>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-6"/>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <serial>e02a2a1a-6766-4e5f-a139-86f6c7e7381f</serial>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:52.787941 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:52.850999 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:43:53.243340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733833.242969, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:43:53.244597 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-e02a2a1a-6766-4e5f-a139-86f6c7e7381f for instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:43:53.247209 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully detached device vdc from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the live domain config.
May 14 04:43:53.248475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:43:53.248765 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:53.248887 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:53.249201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:53.249448 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:43:53.249562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:53.278041 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f (non-flash)
May 14 04:43:53.278639 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', '212')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:43:53.278639 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', '211')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:53.279336 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f', '212')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:53.280228 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f832a660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'): ({'sdk'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:43:53.280392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Removing multipathed devices sdj, sdk {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:43:53.280634 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Flush multipath device 330000000d6ebbf82 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:43:53.311929 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:53.354238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:53.395037 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:43:53.395240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:43:53.396304 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:43:53.407439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:43:53.407598 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:43:53.418843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.454753 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.40.100,3260]
May 14 04:43:53.454753 np0000000747 nova-compute[97971]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.40.100,3260] successful.
May 14 04:43:53.454753 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.473880 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.484856 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.524524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.50.100,3260]
May 14 04:43:53.524524 np0000000747 nova-compute[97971]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-e02a2a1a-6766-4e5f-a139-86f6c7e7381f, portal: 192.168.50.100,3260] successful.
May 14 04:43:53.524524 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.543515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:53.543665 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:53.543814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== disconnect_volume: return (295ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:53.543926 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:43:53.622860 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:53.623319 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] Acquiring lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:53.623478 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:53.623596 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:53.623758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] No waiting events found dispatching network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:43:53.623902 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-unplugged-58724711-d912-40ab-a6e4-ff84d75187f1 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:43:53.624030 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Received event network-vif-deleted-58724711-d912-40ab-a6e4-ff84d75187f1 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:53.624156 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Neutron deleted interface 58724711-d912-40ab-a6e4-ff84d75187f1; detaching it from the instance and deleting it from the info cache
May 14 04:43:53.624263 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:53.694911 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:43:54.086483 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:54.128079 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9fe5a1f3-7f43-498d-a5fc-429b9aab1947 req-df29bff5-8f9d-4949-a675-398864af05f1 service nova] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Detach interface failed, port_id=58724711-d912-40ab-a6e4-ff84d75187f1, reason: Instance 519e07c2-32c7-460a-a83a-b64248c1ee17 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:43:54.196971 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Took 1.43 seconds to deallocate network for instance.
May 14 04:43:54.704135 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:54.704416 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:54.993844 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:43:54.994022 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:43:55.093948 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-a91fca45-b509-4665-963e-eebfe0fe4b1b tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.855s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:55.496490 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:43:55.596963 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:55.597751 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:56.002593 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.298s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:56.053681 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Deleted allocations for instance 519e07c2-32c7-460a-a83a-b64248c1ee17
May 14 04:43:56.100181 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Detaching volume 433fa717-09d4-4e1b-8175-6935dc60721a
May 14 04:43:56.136445 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Attempting to driver detach volume 433fa717-09d4-4e1b-8175-6935dc60721a from mountpoint /dev/vdb
May 14 04:43:56.140967 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found disk vdb by alias ua-433fa717-09d4-4e1b-8175-6935dc60721a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:56.141990 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Found disk vdb by alias ua-433fa717-09d4-4e1b-8175-6935dc60721a {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:43:56.142418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Attempting to detach device vdb from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:43:56.142418 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <alias name="ua-433fa717-09d4-4e1b-8175-6935dc60721a"/>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <serial>433fa717-09d4-4e1b-8175-6935dc60721a</serial>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:56.142418 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:56.147855 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully detached device vdb from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the persistent domain config.
May 14 04:43:56.147945 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] (1/8): Attempting to detach device vdb with device alias ua-433fa717-09d4-4e1b-8175-6935dc60721a from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:43:56.148204 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <alias name="ua-433fa717-09d4-4e1b-8175-6935dc60721a"/>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-7"/>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <serial>433fa717-09d4-4e1b-8175-6935dc60721a</serial>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]: </disk>
May 14 04:43:56.148204 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:43:56.537886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:56.631673 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733836.631268, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => ua-433fa717-09d4-4e1b-8175-6935dc60721a> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:43:56.633293 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-433fa717-09d4-4e1b-8175-6935dc60721a for instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:43:56.635788 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully detached device vdb from instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 from the live domain config.
May 14 04:43:56.636970 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:43:56.637302 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:43:56.637480 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:43:56.637873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:43:56.638246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '433fa717-09d4-4e1b-8175-6935dc60721a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:43:56.638391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:56.671402 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a (non-flash)
May 14 04:43:56.671695 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:43:56.671906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '210')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:43:56.671980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '209')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:56.673272 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a', '210')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:43:56.674458 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bf95f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'): ({'sdm'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:43:56.674734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Removing multipathed devices sdm, sdl {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:43:56.675016 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Flush multipath device 33000000069addc76 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:43:56.718212 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:56.750011 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:43:56.790103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:43:56.790282 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:43:56.791410 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:43:56.803190 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:43:56.803372 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:43:56.815087 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.846655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.40.100,3260]
May 14 04:43:56.846655 np0000000747 nova-compute[97971]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.40.100,3260] successful.
May 14 04:43:56.846655 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.863246 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.872777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.916736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.50.100,3260]
May 14 04:43:56.916736 np0000000747 nova-compute[97971]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-433fa717-09d4-4e1b-8175-6935dc60721a, portal: 192.168.50.100,3260] successful.
May 14 04:43:56.916736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.932644 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:43:56.932862 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:43:56.932988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] <== disconnect_volume: return (295ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:43:56.933161 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:43:57.062256 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-0fe56ea1-b732-4dfb-8a06-d3abde4f4329 tempest-SnapshotDataIntegrityTests-1275007703 tempest-SnapshotDataIntegrityTests-1275007703-project-member] Lock "519e07c2-32c7-460a-a83a-b64248c1ee17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.156s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:57.255216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:57.476493 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'flavor' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:43:58.482014 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-b1a72f0b-8af7-4e43-9e6b-116c5396f556 tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.884s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:58.867843 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:58.868045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:58.868254 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:58.868395 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:58.868513 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:58.870561 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Terminating instance
May 14 04:43:59.228726 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.373783 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:43:59.406938 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.417176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.424574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.429782 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.448160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:43:59.559755 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:43:59.560100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:43:59.560100 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:43:59.560295 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:43:59.560370 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] No waiting events found dispatching network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:43:59.560498 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-60dbdfe6-8fe5-4c62-97ca-718f3eb8d2d9 req-3ac98098-fbc3-4ead-a76c-3bad99124775 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:43:59.703701 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999722234999808 future=<Future at 0x7435f84b0d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:43:59.706065 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Instance destroyed successfully.
May 14 04:43:59.706877 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lazy-loading 'resources' on Instance uuid 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:00.209537 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1877286069',display_name='tempest-TestServerVolumeAttachmentScenario-server-1877286069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testservervolumeattachmentscenario-server-1877286069',id=75,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXuuDvPzzZqhbn5vtO/UnLQ+wakQhHcqRTi+pbU7REkHnDvLYlWv8KaTc7bxtE8VXMJqHD472qfuji12DXWpZ2YtSiPPGHTCSx/9PUhnxYeJz3u3D51yzfbfUReCvUhnw==',key_name='tempest-keypair-1459038210',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:42:47Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b003b259594616b507a7789de64b6f',ramdisk_id='',reservation_id='r-vsdhmdu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1539833072',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1539833072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a90832041e54d5fbcc0052c86e715fd',uuid=2a81cc24-50ca-4fe7-8ebf-f22d91d41257,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:44:00.209750 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converting VIF {"id": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "address": "fa:16:3e:d2:39:f1", "network": {"id": "61672904-e544-4eec-8a8f-90a69014c5f5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-672292408-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "86b003b259594616b507a7789de64b6f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed4a414-2c", "ovs_interfaceid": "0ed4a414-2c44-4377-8b86-3536e6008a2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:00.210237 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:00.210418 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:44:00.211338 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:00.211659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed4a414-2c, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:00.213540 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:00.213894 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:00.214755 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:00.214916 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b45c30b9-ccba-48ce-8188-87cf7825dae6) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:00.216067 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:00.216464 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:00.219105 np0000000747 nova-compute[97971]: INFO os_vif [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:39:f1,bridge_name='br-int',has_traffic_filtering=True,id=0ed4a414-2c44-4377-8b86-3536e6008a2e,network=Network(61672904-e544-4eec-8a8f-90a69014c5f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed4a414-2c')
May 14 04:44:00.219356 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Deleting instance files /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257_del
May 14 04:44:00.220225 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Deletion of /opt/stack/data/nova/instances/2a81cc24-50ca-4fe7-8ebf-f22d91d41257_del complete
May 14 04:44:00.726179 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 04:44:00.726723 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:44:00.726985 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:44:00.727118 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:44:00.727399 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:00.890543 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:00.891934 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:00.896673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:00.903133 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:01.398219 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:01.409076 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a919c2c6-14fe-4b3b-b11d-e6ae0945fd31 req-62e9b527-e40b-48e4-9ba7-0220e3a0ab3d service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-deleted-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:01.409281 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-a919c2c6-14fe-4b3b-b11d-e6ae0945fd31 req-62e9b527-e40b-48e4-9ba7-0220e3a0ab3d service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Neutron deleted interface 0ed4a414-2c44-4377-8b86-3536e6008a2e; detaching it from the instance and deleting it from the info cache
May 14 04:44:01.409442 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a919c2c6-14fe-4b3b-b11d-e6ae0945fd31 req-62e9b527-e40b-48e4-9ba7-0220e3a0ab3d service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:01.539534 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:01.626161 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:01.626337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] Acquiring lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:01.626522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:01.626767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:01.627166 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] No waiting events found dispatching network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:01.627312 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-427490dc-a4f7-44a5-a31c-0b297919b247 req-e0e772ec-f8fc-4bd7-9bc6-d9e01e2a2958 service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Received event network-vif-unplugged-0ed4a414-2c44-4377-8b86-3536e6008a2e for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:44:01.844194 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:01.916977 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a919c2c6-14fe-4b3b-b11d-e6ae0945fd31 req-62e9b527-e40b-48e4-9ba7-0220e3a0ab3d service nova] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Detach interface failed, port_id=0ed4a414-2c44-4377-8b86-3536e6008a2e, reason: Instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:44:02.346518 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Took 1.62 seconds to deallocate network for instance.
May 14 04:44:02.403928 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:02.853897 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:02.854420 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:03.097226 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:03.097420 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:03.490746 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:03.490913 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:03.491161 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Attaching volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 to /dev/vdb
May 14 04:44:03.536830 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:03.550118 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:44:03.570861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:03.602220 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:03.619391 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:44:03.620111 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:44:03.628810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:44:03.629802 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fec5:e72', 'fe80::a495:1eff:fe1e:d316', 'fe80::fc16:3eff:feea:34d7'] 
May 14 04:44:03.629922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:44:03.630064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:44:03.630314 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:03.631468 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating existing volume attachment record: d1de99ea-1740-4aad-805e-7f615b48e907 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:44:04.117241 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.263s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:04.165459 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Deleted allocations for instance 2a81cc24-50ca-4fe7-8ebf-f22d91d41257
May 14 04:44:04.190223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:44:04.190524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:04.190725 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:04.191151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:04.191358 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:44:04.202368 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:04.202726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:04.202906 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:44:04.203654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:04.204223 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:04.204397 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:44:04.215273 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:44:04.215273 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.startup = automatic
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.scan = manual
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:44:04.220895 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:44:04.220895 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:04.227257 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:04.232746 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.243582 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.244777 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.042s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:04.244777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:44:04.245516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('13', '0', '0', 0) found on session 203 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:44:04.245516 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.250946 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:04.251275 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:04.251557 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:04.251645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:44:04.252234 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('14', '0', '0', 0) found on session 204 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:44:04.252377 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:44:04.254439 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 203 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:44:04.254560 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:44:04.262549 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 204 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:44:04.262723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:44:05.173705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-c71ddd37-85aa-4ed0-a95a-dd80a8eae2cc tempest-TestServerVolumeAttachmentScenario-1539833072 tempest-TestServerVolumeAttachmentScenario-1539833072-project-member] Lock "2a81cc24-50ca-4fe7-8ebf-f22d91d41257" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.306s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:05.204879 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:44:05.216182 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:05.481334 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:06.223708 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found WWN 3300000003de2e911 for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:44:06.224088 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:06.224148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '3300000003de2e911', 'path': '/dev/dm-3', 'multipath_id': '3300000003de2e911'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:06.224261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003de2e911', 'path': '/dev/dm-3', 'multipath_id': '3300000003de2e911'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:44:06.227243 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:06.540631 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:06.730026 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Attempting to attach volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:44:06.731440 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:06.731440 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:44:06.741886 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003774589999920863 future=<Future at 0x74361828ab40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:06.742447 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] Emitting event <LifecycleEvent: 1778733831.7413547, 519e07c2-32c7-460a-a83a-b64248c1ee17 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:06.742607 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:06.742808 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] VM Stopped (Lifecycle Event)
May 14 04:44:06.743331 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.960089098000026 future=<Future at 0x7435f84b0d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:06.743939 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=7.959482234999996 future=<Future at 0x7435f84b0d10 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:07.245329 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8c4cbe07-777c-409f-8c38-2bbd24bd264c tempest-TestVolumeBootPattern-948121274 tempest-TestVolumeBootPattern-948121274-project-member] [instance: 519e07c2-32c7-460a-a83a-b64248c1ee17] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:08.381603 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:08.382023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:08.382023 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:08.382111 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:ea:34:d7, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:44:09.145232 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:09.933167 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-1d4fe266-12bb-4ef5-8be0-c9438adb5e33 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.442s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:10.217380 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:11.145376 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:11.542140 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:11.641417 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:11.641629 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:12.144258 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Detaching volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:44:12.188897 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Attempting to driver detach volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 from mountpoint /dev/vdb
May 14 04:44:12.196391 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:12.197665 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:12.197810 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Attempting to detach device vdb from instance 98b0ed19-4498-4df3-865d-f3c3052158da from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:44:12.198072 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:12.198072 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:12.203175 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 98b0ed19-4498-4df3-865d-f3c3052158da from the persistent domain config.
May 14 04:44:12.203433 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] (1/8): Attempting to detach device vdb with device alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 from instance 98b0ed19-4498-4df3-865d-f3c3052158da from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:44:12.203721 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:12.203721 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:12.670948 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733852.6705759, 98b0ed19-4498-4df3-865d-f3c3052158da => ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:44:12.671579 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 for instance 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:44:12.674177 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 98b0ed19-4498-4df3-865d-f3c3052158da from the live domain config.
May 14 04:44:13.215320 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Detected multiple connections on this host for volume: bd4bf3f4-ef24-4aac-b3f6-02750c38a461, skipping target disconnect.
May 14 04:44:13.761493 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:14.703815 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00036780900018129614 future=<Future at 0x7435f84b0d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:14.704199 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:14.704379 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] Emitting event <LifecycleEvent: 1778733839.7033489, 2a81cc24-50ca-4fe7-8ebf-f22d91d41257 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:14.704499 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] VM Stopped (Lifecycle Event)
May 14 04:44:14.767810 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-993b27cf-60de-4e09-82e6-c6b3956e96a1 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.126s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:14.860576 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:14.860787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:14.860976 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:14.861109 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:14.861225 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:14.863595 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Terminating instance
May 14 04:44:15.206710 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-b75fbf47-ddb6-40c4-b9af-52042af57852 tempest-TestEncryptedCinderVolumes-1204475822 tempest-TestEncryptedCinderVolumes-1204475822-project-member] [instance: 2a81cc24-50ca-4fe7-8ebf-f22d91d41257] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:15.218574 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.367571 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:44:15.382537 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.385364 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.400340 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.491862 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.496402 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:15.501135 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:15.501485 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:15.501647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:15.501762 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:15.501865 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] No waiting events found dispatching network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:15.501995 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-91afe640-55f1-4f7e-bcbe-9836d0acaeb2 req-fec0d97e-6aa4-42d0-a093-94089e15bdac service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:44:15.677445 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999727004000306 future=<Future at 0x7435f84b3860 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:15.677845 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999300494000181 future=<Future at 0x7435f84b3860 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:15.678024 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999093971000093 future=<Future at 0x7435f84b3860 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:15.678990 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Instance destroyed successfully.
May 14 04:44:15.679649 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'resources' on Instance uuid 98b0ed19-4498-4df3-865d-f3c3052158da {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:16.181465 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1679916146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1679916146',id=77,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:43:35Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-ed8yat40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=98b0ed19-4498-4df3-865d-f3c3052158da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:44:16.181973 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "address": "fa:16:3e:ea:34:d7", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4f227a-13", "ovs_interfaceid": "ca4f227a-13af-456e-b49b-743aa0a0ba1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:16.182235 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:16.182439 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:44:16.183531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.183718 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4f227a-13, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:16.194413 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.195177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:16.195461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.196167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.196287 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbf37fb1-130a-4269-8c3f-8e6ad57f1ea8) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:16.196673 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.197111 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:16.197603 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.199730 np0000000747 nova-compute[97971]: INFO os_vif [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:34:d7,bridge_name='br-int',has_traffic_filtering=True,id=ca4f227a-13af-456e-b49b-743aa0a0ba1b,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4f227a-13')
May 14 04:44:16.200326 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Deleting instance files /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da_del
May 14 04:44:16.201077 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Deletion of /opt/stack/data/nova/instances/98b0ed19-4498-4df3-865d-f3c3052158da_del complete
May 14 04:44:16.544461 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:16.707477 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Took 1.34 seconds to destroy the instance on the hypervisor.
May 14 04:44:16.708173 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:44:16.708490 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:44:16.708624 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:44:16.708925 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:16.780555 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:17.553527 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:17.553869 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] Acquiring lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:17.553962 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:17.554083 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] Lock "98b0ed19-4498-4df3-865d-f3c3052158da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:17.554204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] No waiting events found dispatching network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:17.554307 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-unplugged-ca4f227a-13af-456e-b49b-743aa0a0ba1b for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:44:17.554402 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Received event network-vif-deleted-ca4f227a-13af-456e-b49b-743aa0a0ba1b {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:17.554504 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Neutron deleted interface ca4f227a-13af-456e-b49b-743aa0a0ba1b; detaching it from the instance and deleting it from the info cache
May 14 04:44:17.554628 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:17.586608 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:18.058693 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-1bc0176e-7de4-4f2e-bca5-0d63eeab77d4 req-74db4b99-0d58-45b7-9c62-e0bf3980498a service nova] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Detach interface failed, port_id=ca4f227a-13af-456e-b49b-743aa0a0ba1b, reason: Instance 98b0ed19-4498-4df3-865d-f3c3052158da could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:44:18.088340 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Took 1.38 seconds to deallocate network for instance.
May 14 04:44:18.198647 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:18.198818 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:18.593482 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:18.593969 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:18.700322 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:44:18.797362 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:18.797551 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:19.247180 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:19.299990 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:19.806108 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.212s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:19.807714 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.559s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:19.812833 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:44:19.813098 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Claim successful on node np0000000747
May 14 04:44:19.852874 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Deleted allocations for instance 98b0ed19-4498-4df3-865d-f3c3052158da
May 14 04:44:20.862676 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc921d5c-bcfa-4e1e-acc1-25b3630d464e tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "98b0ed19-4498-4df3-865d-f3c3052158da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:20.972229 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:20.972428 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:21.216396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:21.474921 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:21.958194 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:21.958516 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:21.981748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.175s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:21.982064 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:44:22.460696 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Detaching volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461
May 14 04:44:22.488411 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:44:22.488662 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:44:22.489028 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:22.489315 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:22.495649 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to driver detach volume bd4bf3f4-ef24-4aac-b3f6-02750c38a461 from mountpoint /dev/vdd
May 14 04:44:22.500973 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdd by alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:22.502251 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdd by alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:22.502461 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Attempting to detach device vdd from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:44:22.502781 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <target dev="vdd" bus="virtio"/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:22.502781 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:22.512216 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdd from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config.
May 14 04:44:22.512343 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] (1/8): Attempting to detach device vdd with device alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:44:22.512627 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <alias name="ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461"/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-3"/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <target dev="vdd" bus="virtio"/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <serial>bd4bf3f4-ef24-4aac-b3f6-02750c38a461</serial>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:22.512627 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:22.557327 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0386f2a607ee4edda3d9a711ce02eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7eb6509a24d34807cf5fb11dcb7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:44:22.978427 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733862.9781113, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:44:22.979433 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 for instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:44:22.981598 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdd from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config.
May 14 04:44:22.992516 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:44:22.999165 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Successfully created port: 6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:44:23.012250 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:44:23.012512 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:23.012650 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:23.012966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:23.013218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:44:23.013332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:23.038365 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:23.038852 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:44:23.038852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '203')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:23.039536 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461', '204')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:23.040247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8328fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'): ({'sdi'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:44:23.040412 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:44:23.040621 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flush multipath device 3300000003de2e911 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:44:23.076698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:23.127194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:23.177117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:44:23.177267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:44:23.178154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:44:23.189006 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:44:23.189227 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:44:23.201096 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.235814 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.40.100,3260]
May 14 04:44:23.235814 np0000000747 nova-compute[97971]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.40.100,3260] successful.
May 14 04:44:23.235814 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.261064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.272022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.300810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.50.100,3260]
May 14 04:44:23.300810 np0000000747 nova-compute[97971]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-bd4bf3f4-ef24-4aac-b3f6-02750c38a461, portal: 192.168.50.100,3260] successful.
May 14 04:44:23.300810 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.320591 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:23.320904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:23.321052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== disconnect_volume: return (308ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:23.321197 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:44:23.437750 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Successfully updated port: 6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:44:23.489968 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-changed-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:23.490103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Refreshing instance network info cache due to event network-changed-6804e553-0520-4ccc-8c1d-77a811387a83. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:44:23.490710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] Acquiring lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:44:23.490710 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] Acquired lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:44:23.490710 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Refreshing network info cache for port 6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:44:23.495680 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:44:23.866357 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:23.939536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:44:23.992290 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:23.999981 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Booting with volume 6e85da25-bed4-45be-8c3f-094734d859bd at /dev/vda
May 14 04:44:24.036469 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:24.046829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:44:24.051130 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:44:24.066126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:24.115373 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:44:24.115684 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:44:24.125744 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:44:24.127045 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fe38:999f', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fec5:e72', 'fe80::a495:1eff:fe1e:d316'] 
May 14 04:44:24.128094 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:44:24.128240 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:44:24.131452 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:24.131698 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating existing volume attachment record: e6b6ad46-e72f-44c7-a459-6c0561c929f9 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:44:24.194433 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:24.602559 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:24.602967 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:24.696581 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-940be73a-5109-4664-ad74-f78a552ff94c req-5dddbbf8-a971-49fb-89e2-20d126f8c11e service nova] Releasing lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:44:24.697057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquired lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:44:24.697210 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:44:24.872683 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bc5509c3-dfba-4567-b103-cca6781133cc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.914s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:25.222606 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:25.223184 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:25.258480 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:44:25.394504 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:25.504758 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating instance_info_cache with network_info: [{"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:25.609872 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:25.610077 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:25.727185 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Detaching volume 7e0493ba-3a5e-42f3-89fa-658ab8b6adc6
May 14 04:44:25.766781 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to driver detach volume 7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 from mountpoint /dev/vdc
May 14 04:44:25.792296 np0000000747 nova-compute[97971]: DEBUG os_brick.encryptors [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '5aaaf66c-6055-4f5a-add8-fb3bbe588f87', 'attached_at': '', 'detached_at': '', 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'serial': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'} {{(pid=97971) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 14 04:44:25.795938 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdc by alias ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:25.797220 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdc by alias ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:25.797378 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Attempting to detach device vdc from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:44:25.797694 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <alias name="ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <serial>7e0493ba-3a5e-42f3-89fa-658ab8b6adc6</serial>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="3db548ca-ce21-435e-9da5-0d9f6226b3cb"/>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:25.797694 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:25.803142 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdc from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config.
May 14 04:44:25.803327 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] (1/8): Attempting to detach device vdc with device alias ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:44:25.803512 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <alias name="ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <target dev="vdc" bus="virtio"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <serial>7e0493ba-3a5e-42f3-89fa-658ab8b6adc6</serial>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   <encryption format="luks">
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:     <secret type="passphrase" uuid="3db548ca-ce21-435e-9da5-0d9f6226b3cb"/>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:   </encryption>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:25.803512 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:26.006787 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Releasing lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:44:26.006998 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance network_info: |[{"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:44:26.115567 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:26.115748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:26.115865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:26.115985 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:44:26.217679 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:26.219765 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:44:26.220761 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:44:26.221026 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Creating image(s)
May 14 04:44:26.221318 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:44:26.221536 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Ensure instance console log exists: /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:44:26.221747 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:26.221960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:26.222116 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:26.222633 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Start _get_guest_xml network_info=[{"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e6b6ad46-e72f-44c7-a459-6c0561c929f9', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533', 'attached_at': '', 'detached_at': '', 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'serial': '6e85da25-bed4-45be-8c3f-094734d859bd'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:44:26.225798 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:44:26.226717 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1850629351', uuid='73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533'), owner=OwnerMeta(userid='0386f2a607ee4edda3d9a711ce02eeee', username='tempest-TestVolumeBootPatternV346-645608592-project-member', projectid='cce7eb6509a24d34807cf5fb11dcb7ba', projectname='tempest-TestVolumeBootPatternV346-645608592'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733866.2264314) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:44:26.228147 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:44:26.228524 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:44:26.229835 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:44:26.230008 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:44:26.231083 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:44:26.231556 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:44:26.231779 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:44:26.231936 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:44:26.232108 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:44:26.232235 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:44:26.232330 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:44:26.232571 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:44:26.232729 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:44:26.232911 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:44:26.233070 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:44:26.233244 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:44:26.242880 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733866.2425025, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:44:26.243739 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 for instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:44:26.247028 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdc from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config.
May 14 04:44:26.247510 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:44:26.247917 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:26.248109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:26.248543 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:26.248754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:44:26.250377 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:44:26.250718 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:26.250880 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:26.261048 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:26.261605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:26.262114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:26.262445 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:44:26.262869 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:26.263676 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:44:26.273197 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:44:26.273197 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:26.279053 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:44:26.279053 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:26.286342 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd] added
May 14 04:44:26.286342 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:44:26.286342 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:44:26.286342 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:44:26.286342 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:44:26.286342 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:44:26.286342 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:26.286551 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:44:26.286708 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:44:26.286888 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd] added
May 14 04:44:26.290522 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:44:26.290522 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:44:26.290522 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:44:27.142297 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:44:27.143901 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:27.234836 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:27.235315 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:27.287698 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:44:27.291081 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:44:27.302349 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:44:27.302349 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:44:27.308515 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:44:27.308515 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.315839 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.324149 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.330391 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.330672 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:27.331106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:27.331587 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:44:27.335415 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:44:27.336405 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.350235 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.350503 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:27.369404 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.40.100,3260]
May 14 04:44:27.369404 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.40.100,3260] successful.
May 14 04:44:27.369404 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.379428 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.385858 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:27.386179 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13558MB free_disk=72.60939407348633GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:44:27.386311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:27.386536 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:27.388900 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.50.100,3260]
May 14 04:44:27.388900 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.50.100,3260] successful.
May 14 04:44:27.388900 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.397362 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.397672 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:27.398148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:27.398148 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:44:27.398942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('13', '-', '-', 0) found on session 213 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:44:27.399047 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:44:27.400906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:27.412653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 213 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:44:27.412653 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.420367 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:27.420697 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:27.420962 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:27.421045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:44:27.421810 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('14', '-', '-', 0) found on session 214 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:44:27.421905 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:44:27.436326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 214 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:44:27.436326 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:44:28.262873 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:44:28.437791 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:44:28.437990 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance cff8c6a7-d5e1-4115-8690-25399c05f1f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:44:28.438099 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:44:28.438263 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:44:28.438380 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:44:27 up 44 min,  2 users,  load average: 2.81, 5.04, 5.01\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_9942017b2e7541a3971a106d228bd9d6': '1', 'io_workload': '1', 'num_proj_cce7eb6509a24d34807cf5fb11dcb7ba': '2', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:44:28.592493 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:28.592825 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:29.095460 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:29.278754 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Found WWN 330000000c0e04dae for multipath device dm-3 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:44:29.279277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:29.279277 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000c0e04dae', 'path': '/dev/dm-3', 'multipath_id': '330000000c0e04dae'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:29.279387 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c0e04dae', 'path': '/dev/dm-3', 'multipath_id': '330000000c0e04dae'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:44:29.279988 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.029s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:29.280413 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:44:29.280569 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:29.307052 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6 (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:29.307321 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:29.307321 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:44:29.307520 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '200')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:29.308287 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6', '199')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:29.309025 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bf96ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'): ({'sdf'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:44:29.309200 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:44:29.309415 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flush multipath device 3300000002ebf4591 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:44:29.337995 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:29.377161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:29.414004 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:44:29.414237 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:44:29.415338 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:44:29.428311 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:44:29.428476 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:44:29.439700 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.475626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.40.100,3260]
May 14 04:44:29.475626 np0000000747 nova-compute[97971]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.40.100,3260] successful.
May 14 04:44:29.475626 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.491250 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.502034 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.530403 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.50.100,3260]
May 14 04:44:29.530403 np0000000747 nova-compute[97971]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-7e0493ba-3a5e-42f3-89fa-658ab8b6adc6, portal: 192.168.50.100,3260] successful.
May 14 04:44:29.530403 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.545066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:29.545809 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:29.545925 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== disconnect_volume: return (3295ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:29.546018 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:44:29.602017 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:44:29.602275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.216s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:29.602743 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:29.787006 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1850629351',display_name='tempest-TestVolumeBootPatternV346-server-1850629351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1850629351',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmxUlJ8ptfwW3WlOOmIFucZQqi3d7b6I2C9wvamNpRVPMSwd1WSylmIUEf02tJ+b8vzh+lXWWt3mkZN43l1dUoT8SmW93HyxvMyCvNzOi8d7AOBexlRZqzP4nllHWJW+w==',key_name='tempest-keypair-1648393332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-kmluv4qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:44:29.787205 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:29.787899 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:29.788682 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:30.087110 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:30.291659 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] End _get_guest_xml xml=<domain type="qemu">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <uuid>73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533</uuid>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <name>instance-0000004e</name>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1850629351</nova:name>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:44:26</nova:creationTime>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:user uuid="0386f2a607ee4edda3d9a711ce02eeee">tempest-TestVolumeBootPatternV346-645608592-project-member</nova:user>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:project uuid="cce7eb6509a24d34807cf5fb11dcb7ba">tempest-TestVolumeBootPatternV346-645608592</nova:project>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         <nova:port uuid="6804e553-0520-4ccc-8c1d-77a811387a83">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <system>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="serial">73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="uuid">73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </system>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <os>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </os>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <features>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </features>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   <devices>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/disk.config"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </disk>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <alias name="ua-6e85da25-bed4-45be-8c3f-094734d859bd"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-3"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <serial>6e85da25-bed4-45be-8c3f-094734d859bd</serial>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </disk>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:09:4f:9b"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <target dev="tap6804e553-05"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </interface>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/console.log" append="off"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </serial>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <video>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </video>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </rng>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:   </devices>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]: </domain>
May 14 04:44:30.291659 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Preparing to wait for external event network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1850629351',display_name='tempest-TestVolumeBootPatternV346-server-1850629351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1850629351',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmxUlJ8ptfwW3WlOOmIFucZQqi3d7b6I2C9wvamNpRVPMSwd1WSylmIUEf02tJ+b8vzh+lXWWt3mkZN43l1dUoT8SmW93HyxvMyCvNzOi8d7AOBexlRZqzP4nllHWJW+w==',key_name='tempest-keypair-1648393332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-kmluv4qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:30.293903 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:44:30.294317 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.294747 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:30.295030 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:44:30.295682 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.295859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d66cc1d-30e7-5df4-bc5a-ece5f3df7c9d', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:30.296597 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.297246 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:30.297541 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.299275 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.299400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6804e553-05, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:30.299698 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6804e553-05, col_values=(('qos', UUID('6d732de4-a2e9-4fe1-af3d-976b363d09fa')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:30.299868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6804e553-05, col_values=(('external_ids', {'iface-id': '6804e553-0520-4ccc-8c1d-77a811387a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:4f:9b', 'vm-uuid': '73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:30.300431 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.301388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:30.305853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:30.306704 np0000000747 nova-compute[97971]: INFO os_vif [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05')
May 14 04:44:30.677685 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0004221929998493579 future=<Future at 0x7435f84b3860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:30.678134 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733855.677056, 98b0ed19-4498-4df3-865d-f3c3052158da => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:30.678316 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:30.678482 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] VM Stopped (Lifecycle Event)
May 14 04:44:31.092074 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-107da34b-b6c7-48fe-8f71-f28a32deb1dc tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.869s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:31.180795 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 98b0ed19-4498-4df3-865d-f3c3052158da] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:31.565268 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:31.565821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:31.602373 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:31.602731 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:31.602943 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:31.603200 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:31.609562 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:31.609783 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:31.821257 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:31.821394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:31.821548 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No VIF found with MAC fa:16:3e:09:4f:9b, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:44:31.821965 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Using config drive
May 14 04:44:32.067880 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Detaching volume 9547318a-6993-4d7a-ab40-2765d87a3a6d
May 14 04:44:32.102457 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Attempting to driver detach volume 9547318a-6993-4d7a-ab40-2765d87a3a6d from mountpoint /dev/vdb
May 14 04:44:32.107138 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-9547318a-6993-4d7a-ab40-2765d87a3a6d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:32.108512 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-9547318a-6993-4d7a-ab40-2765d87a3a6d {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:44:32.108664 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Attempting to detach device vdb from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:44:32.108934 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <alias name="ua-9547318a-6993-4d7a-ab40-2765d87a3a6d"/>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <serial>9547318a-6993-4d7a-ab40-2765d87a3a6d</serial>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:32.108934 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:32.114716 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the persistent domain config.
May 14 04:44:32.114881 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] (1/8): Attempting to detach device vdb with device alias ua-9547318a-6993-4d7a-ab40-2765d87a3a6d from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:44:32.115140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <alias name="ua-9547318a-6993-4d7a-ab40-2765d87a3a6d"/>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-0"/>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <serial>9547318a-6993-4d7a-ab40-2765d87a3a6d</serial>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]: </disk>
May 14 04:44:32.115140 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:44:32.326906 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:32.433277 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Creating config drive at /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/disk.config
May 14 04:44:32.437030 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2q8q8g8 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:32.492726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw2q8q8g8" returned: 0 in 0.055s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:32.544417 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733872.5437276, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => ua-9547318a-6993-4d7a-ab40-2765d87a3a6d> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:44:32.547417 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9547318a-6993-4d7a-ab40-2765d87a3a6d for instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:44:32.550469 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 from the live domain config.
May 14 04:44:32.551954 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:44:32.552485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:44:32.552797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:44:32.553359 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:44:32.553829 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9547318a-6993-4d7a-ab40-2765d87a3a6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:44:32.554026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:32.578903 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:44:32.579419 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:44:32.579419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '196')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:32.580056 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d', '195')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:44:32.580722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x743618321440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:44:32.580946 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:44:32.581166 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flush multipath device 33000000021a28b6c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:44:32.611823 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:32.656027 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:44:32.692100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:44:32.692261 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:44:32.693238 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:44:32.703372 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:44:32.703572 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:44:32.712708 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.747906 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.40.100,3260]
May 14 04:44:32.747906 np0000000747 nova-compute[97971]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.40.100,3260] successful.
May 14 04:44:32.747906 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.762481 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.775393 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.802405 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.50.100,3260]
May 14 04:44:32.802405 np0000000747 nova-compute[97971]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-9547318a-6993-4d7a-ab40-2765d87a3a6d, portal: 192.168.50.100,3260] successful.
May 14 04:44:32.802405 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.815950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:44:32.815950 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:44:32.816072 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== disconnect_volume: return (263ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:44:32.816171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:44:32.901957 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:32.922882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:32.924250 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:33.003104 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:33.014440 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:33.015063 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:33.358639 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:33.498153 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7ccf226-9493-4628-ab22-cd3d0e8b898f req-dedcdea6-28c0-41f8-9a8a-41ca214587e0 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:33.498602 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7ccf226-9493-4628-ab22-cd3d0e8b898f req-dedcdea6-28c0-41f8-9a8a-41ca214587e0 service nova] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:33.498834 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7ccf226-9493-4628-ab22-cd3d0e8b898f req-dedcdea6-28c0-41f8-9a8a-41ca214587e0 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:33.498986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-d7ccf226-9493-4628-ab22-cd3d0e8b898f req-dedcdea6-28c0-41f8-9a8a-41ca214587e0 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:33.499117 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-d7ccf226-9493-4628-ab22-cd3d0e8b898f req-dedcdea6-28c0-41f8-9a8a-41ca214587e0 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Processing event network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:44:33.580322 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733873.5799825, 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:33.580661 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] VM Started (Lifecycle Event)
May 14 04:44:33.581710 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:44:33.583895 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:44:33.586691 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance spawned successfully.
May 14 04:44:33.587053 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:44:33.609892 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:33.610257 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:44:33.610506 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:34.082758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:34.084843 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:44:34.093270 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.093394 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.093678 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.094014 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.094288 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.094533 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:34.365337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-7c27fb30-1214-4a31-a684-22b290b8e5de tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.800s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:34.586996 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:44:34.587427 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733874.5871813, 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:34.587499 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] VM Paused (Lifecycle Event)
May 14 04:44:34.598893 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Took 8.38 seconds to spawn the instance on the hypervisor.
May 14 04:44:34.599284 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:35.089705 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:35.091958 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733875.0917394, 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:35.092070 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] VM Resumed (Lifecycle Event)
May 14 04:44:35.108442 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Took 15.90 seconds to build instance.
May 14 04:44:35.302158 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:35.562748 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:35.562973 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:35.563113 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:35.564138 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:35.564279 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] No waiting events found dispatching network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:35.564413 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-f3f629b4-63a0-4ca5-b8f2-08e558c1d3fb req-b39099ae-3cfd-4543-9dc2-3ef5080c4da4 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received unexpected event network-vif-plugged-6804e553-0520-4ccc-8c1d-77a811387a83 for instance with vm_state active and task_state None.
May 14 04:44:35.588382 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:35.594252 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:35.596667 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:44:35.610058 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-64f0ab00-acda-4121-963b-1cbbfdec7ad0 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.411s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:35.697562 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-changed-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:35.697965 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Refreshing instance network info cache due to event network-changed-6804e553-0520-4ccc-8c1d-77a811387a83. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:44:35.698150 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] Acquiring lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:44:35.698248 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] Acquired lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:44:35.698397 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Refreshing network info cache for port 6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:44:36.200166 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:36.494604 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:36.547483 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:36.622158 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updated VIF entry in instance network info cache for port 6804e553-0520-4ccc-8c1d-77a811387a83. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:44:36.622488 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating instance_info_cache with network_info: [{"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:37.124124 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9f75794f-f577-4ffe-812c-0f3c6d4cacc5 req-b315919b-5b77-4a2b-b757-d7a5978d1e00 service nova] Releasing lock "refresh_cache-73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:44:37.610508 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:44:37.610917 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:44:38.181428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:38.181849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:38.181849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:38.181849 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:38.181932 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:38.183975 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Terminating instance
May 14 04:44:38.688538 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:44:38.719522 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:38.724098 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:38.727468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:38.746563 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:38.854104 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:38.854276 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:38.854431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:38.854603 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:38.854812 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] No waiting events found dispatching network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:38.854991 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-9001e09e-f311-4da8-8db4-8dbcb5b0a448 req-d996d743-770a-4bf8-ac8e-f9630fc060f2 service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:44:39.014817 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99959532999992 future=<Future at 0x7435f8218440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:39.015336 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999039841000013 future=<Future at 0x7435f8218440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:39.015563 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998781031999897 future=<Future at 0x7435f8218440 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:39.016376 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Instance destroyed successfully.
May 14 04:44:39.016789 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'resources' on Instance uuid 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:39.522249 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1330332910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-1330332910',id=74,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZRQ94neNn1RgW5/50gQFqpHH7rXtWTc3SCD9XFW/C9EAJBICYT6kuy/wDPDZKZAwqbUmoJVsCsaETAqf2czRNOROxAsy24j+4F8uo4MYxs1habO3LcxPmuSushQ1CNxg==',key_name='tempest-keypair-1839069667',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:42:03Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-vwahy63v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=5aaaf66c-6055-4f5a-add8-fb3bbe588f87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:44:39.522942 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "address": "fa:16:3e:38:99:9f", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c622dea-fc", "ovs_interfaceid": "5c622dea-fc9d-4780-a6d2-fad9c4f037bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:39.523036 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:39.523241 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:44:39.525813 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:39.525813 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c622dea-fc, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:39.527531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:39.527531 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:39.528452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:39.528452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72412a13-95e2-4cf0-8c10-5ae0937970db) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:39.528720 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:39.529591 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:39.531185 np0000000747 nova-compute[97971]: INFO os_vif [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:99:9f,bridge_name='br-int',has_traffic_filtering=True,id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c622dea-fc')
May 14 04:44:39.531436 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Deleting instance files /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87_del
May 14 04:44:39.532101 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Deletion of /opt/stack/data/nova/instances/5aaaf66c-6055-4f5a-add8-fb3bbe588f87_del complete
May 14 04:44:40.037505 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Took 1.35 seconds to destroy the instance on the hypervisor.
May 14 04:44:40.038047 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:44:40.041639 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:44:40.041639 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:44:40.041639 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:40.139510 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:40.411723 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b102b38f-2296-495c-9578-7a01e173df27 req-e24b5452-07d9-44f3-ac4b-f4dcfd2a36cb service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-deleted-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:40.412234 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-b102b38f-2296-495c-9578-7a01e173df27 req-e24b5452-07d9-44f3-ac4b-f4dcfd2a36cb service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Neutron deleted interface 5c622dea-fc9d-4780-a6d2-fad9c4f037bd; detaching it from the instance and deleting it from the info cache
May 14 04:44:40.412381 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-b102b38f-2296-495c-9578-7a01e173df27 req-e24b5452-07d9-44f3-ac4b-f4dcfd2a36cb service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:40.865440 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:40.916795 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-b102b38f-2296-495c-9578-7a01e173df27 req-e24b5452-07d9-44f3-ac4b-f4dcfd2a36cb service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Detach interface failed, port_id=5c622dea-fc9d-4780-a6d2-fad9c4f037bd, reason: Instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:44:40.925217 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:40.925413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] Acquiring lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:40.925506 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:40.925709 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:40.925845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] No waiting events found dispatching network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:44:40.925946 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-3147893b-1056-4cc1-b65f-654a8c5fca35 req-8c5e2796-5869-4b0b-b384-aec2d666b20c service nova] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Received event network-vif-unplugged-5c622dea-fc9d-4780-a6d2-fad9c4f037bd for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:44:41.367763 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Took 1.33 seconds to deallocate network for instance.
May 14 04:44:41.548980 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:41.873412 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:41.873895 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:42.032198 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:42.032427 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:42.535112 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:43.043228 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.169s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:43.088626 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Deleted allocations for instance 5aaaf66c-6055-4f5a-add8-fb3bbe588f87
May 14 04:44:44.097499 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bfc12594-4103-4b69-bb09-85ab334b4cf8 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "5aaaf66c-6055-4f5a-add8-fb3bbe588f87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.916s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:44.529279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:46.550859 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:48.449451 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:48.449949 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:48.952215 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:44:49.497748 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:49.498112 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:49.501300 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:44:49.501482 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Claim successful on node np0000000747
May 14 04:44:49.530580 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:50.660139 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:44:50.660683 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:44:51.162546 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:44:51.551630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:51.668243 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.170s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:51.668797 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:44:52.174039 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:44:52.174711 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:44:52.174711 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:52.174869 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:52.255550 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '727fba2b300b4d4596102544c1a6d398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9942017b2e7541a3971a106d228bd9d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:44:52.674783 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:44:52.721140 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Successfully created port: 30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:44:53.143926 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Successfully updated port: 30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:44:53.177486 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:44:53.188604 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-changed-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:53.189122 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Refreshing instance network info cache due to event network-changed-30b1ac61-97a8-4b92-9992-446de7a24f43. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:44:53.189281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] Acquiring lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:44:53.189421 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] Acquired lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:44:53.189504 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Refreshing network info cache for port 30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:44:53.645705 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:44:53.691933 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:53.745486 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:44:53.857804 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:54.014919 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00045333000025493675 future=<Future at 0x7435f8218440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:54.015410 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] Emitting event <LifecycleEvent: 1778733879.0142708, 5aaaf66c-6055-4f5a-add8-fb3bbe588f87 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:54.015592 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:44:54.015760 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] VM Stopped (Lifecycle Event)
May 14 04:44:54.184546 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:44:54.185469 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:44:54.185735 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Creating image(s)
May 14 04:44:54.186152 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:54.186320 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:54.186769 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:54.187246 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:44:54.189634 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:44:54.190597 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:54.281975 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.091s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:54.282365 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:54.283268 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:54.283807 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:44:54.286379 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:44:54.286713 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:54.360224 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-df7ad992-e996-4c8e-a93e-41a9d98f5e2a req-6123cb83-72ef-4603-a032-43add0e7097f service nova] Releasing lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:44:54.360983 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquired lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:44:54.361246 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:44:54.374569 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.088s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:54.375052 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:54.436013 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk 1073741824" returned: 0 in 0.061s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:54.436474 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:54.436814 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:54.519345 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-a24589e9-c37c-489c-84f1-bf388078bedf tempest-TestServerVolumeAttachScenarioOldVersion-1833525292 tempest-TestServerVolumeAttachScenarioOldVersion-1833525292-project-member] [instance: 5aaaf66c-6055-4f5a-add8-fb3bbe588f87] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:54.520539 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:54.520988 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:44:54.521211 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:54.534244 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:54.611023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:54.611445 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Cannot resize image /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:44:54.611839 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:44:54.612012 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Ensure instance console log exists: /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:44:54.612260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:54.612491 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:54.612754 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:54.917830 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:44:55.057883 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:55.166689 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating instance_info_cache with network_info: [{"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:44:55.668361 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Releasing lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:44:55.668740 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance network_info: |[{"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:44:55.670407 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Start _get_guest_xml network_info=[{"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:44:55.673045 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:44:55.674166 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-942977923', uuid='74356c4e-25ee-427f-adb6-c467cf34ac97'), owner=OwnerMeta(userid='727fba2b300b4d4596102544c1a6d398', username='tempest-VolumeMultiattachTests-2142682089-project-member', projectid='9942017b2e7541a3971a106d228bd9d6', projectname='tempest-VolumeMultiattachTests-2142682089'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733895.6738706) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:44:55.675266 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:44:55.675545 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:44:55.676499 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:44:55.676711 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:44:55.677491 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:44:55.677781 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:44:55.678476 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:44:55.678721 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:44:55.678721 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:44:55.678829 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:44:55.688249 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-942977923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-942977923',id=79,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGAwUjbsK6iEz6PlcGCP01qlyG30exI3mFGICAQLi0oV0PssuUyguU8waP+et+tJ+oN+7/2VIw0/ydGBk3x7AKPrBuYv5bwct8pZ9NNG6wkJeNOGILsYvdIPzpaAtf7sA==',key_name='tempest-keypair-2084449755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-3x2dfq08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=74356c4e-25ee-427f-adb6-c467cf34ac97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:44:55.688450 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:55.688918 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:55.689375 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'pci_devices' on Instance uuid 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:44:56.192165 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] End _get_guest_xml xml=<domain type="qemu">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <uuid>74356c4e-25ee-427f-adb6-c467cf34ac97</uuid>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <name>instance-0000004f</name>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:name>tempest-VolumeMultiattachTests-server-942977923</nova:name>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:44:55</nova:creationTime>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:user uuid="727fba2b300b4d4596102544c1a6d398">tempest-VolumeMultiattachTests-2142682089-project-member</nova:user>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:project uuid="9942017b2e7541a3971a106d228bd9d6">tempest-VolumeMultiattachTests-2142682089</nova:project>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         <nova:port uuid="30b1ac61-97a8-4b92-9992-446de7a24f43">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <system>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="serial">74356c4e-25ee-427f-adb6-c467cf34ac97</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="uuid">74356c4e-25ee-427f-adb6-c467cf34ac97</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </system>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <os>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </os>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <features>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </features>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   <devices>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </disk>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.config"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </disk>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:ee:93:dc"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <target dev="tap30b1ac61-97"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </interface>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/console.log" append="off"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </serial>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <video>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </video>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </rng>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:   </devices>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]: </domain>
May 14 04:44:56.192165 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Preparing to wait for external event network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-942977923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-942977923',id=79,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGAwUjbsK6iEz6PlcGCP01qlyG30exI3mFGICAQLi0oV0PssuUyguU8waP+et+tJ+oN+7/2VIw0/ydGBk3x7AKPrBuYv5bwct8pZ9NNG6wkJeNOGILsYvdIPzpaAtf7sA==',key_name='tempest-keypair-2084449755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-3x2dfq08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=74356c4e-25ee-427f-adb6-c467cf34ac97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.195564 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ab9fd54-1d20-51e8-868b-badeb26fbbd9', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:56.196402 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.196626 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:56.197020 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.198671 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.198784 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30b1ac61-97, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:56.199031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30b1ac61-97, col_values=(('qos', UUID('151f9382-e6f8-4ecc-b511-634451523093')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:56.199175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30b1ac61-97, col_values=(('external_ids', {'iface-id': '30b1ac61-97a8-4b92-9992-446de7a24f43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:93:dc', 'vm-uuid': '74356c4e-25ee-427f-adb6-c467cf34ac97'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:44:56.199787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.200749 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:44:56.204930 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:56.205603 np0000000747 nova-compute[97971]: INFO os_vif [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97')
May 14 04:44:56.552824 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:57.720421 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:57.720890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:44:57.720890 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:ee:93:dc, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:44:57.721136 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Using config drive
May 14 04:44:58.226131 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:44:58.332472 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Creating config drive at /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.config
May 14 04:44:58.336409 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnp1_3z2o {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:44:58.406402 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnp1_3z2o" returned: 0 in 0.070s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:44:58.776160 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:58.794009 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:58.796853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:58.879847 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:58.925002 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cfa59af6-2416-457e-9541-932db5397593 req-92a88b39-ad45-4889-b54d-05f18ec349de service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:44:58.925259 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cfa59af6-2416-457e-9541-932db5397593 req-92a88b39-ad45-4889-b54d-05f18ec349de service nova] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:44:58.925450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cfa59af6-2416-457e-9541-932db5397593 req-92a88b39-ad45-4889-b54d-05f18ec349de service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:44:58.925632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-cfa59af6-2416-457e-9541-932db5397593 req-92a88b39-ad45-4889-b54d-05f18ec349de service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:44:58.925769 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-cfa59af6-2416-457e-9541-932db5397593 req-92a88b39-ad45-4889-b54d-05f18ec349de service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Processing event network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:44:59.042241 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:59.043542 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:59.045927 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:59.059776 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:44:59.428084 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733899.4276857, 74356c4e-25ee-427f-adb6-c467cf34ac97 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:44:59.429261 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:44:59.429436 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] VM Started (Lifecycle Event)
May 14 04:44:59.431317 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:44:59.433912 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance spawned successfully.
May 14 04:44:59.435402 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:44:59.932491 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:44:59.934568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:44:59.940246 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:59.940382 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:59.940735 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:59.941025 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:59.941338 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:44:59.941708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:00.438329 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:45:00.438626 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733900.4384036, 74356c4e-25ee-427f-adb6-c467cf34ac97 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:45:00.438789 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] VM Paused (Lifecycle Event)
May 14 04:45:00.446388 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Took 6.26 seconds to spawn the instance on the hypervisor.
May 14 04:45:00.446543 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:00.941351 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:00.943676 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733900.943401, 74356c4e-25ee-427f-adb6-c467cf34ac97 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:45:00.943814 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] VM Resumed (Lifecycle Event)
May 14 04:45:00.969104 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Took 11.51 seconds to build instance.
May 14 04:45:00.996813 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:00.996986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:00.997189 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:00.997310 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:00.997437 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] No waiting events found dispatching network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:45:00.997590 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-6425d176-373e-4477-954b-33d595c81e3f req-01d42004-aa07-4eb0-ab8f-4ccd32414e43 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received unexpected event network-vif-plugged-30b1ac61-97a8-4b92-9992-446de7a24f43 for instance with vm_state active and task_state None.
May 14 04:45:01.199714 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:01.446220 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:01.448135 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:45:01.470761 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.021s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:01.554920 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:03.054508 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-changed-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:03.054874 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Refreshing instance network info cache due to event network-changed-30b1ac61-97a8-4b92-9992-446de7a24f43. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:45:03.054874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] Acquiring lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:45:03.054874 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] Acquired lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:45:03.055035 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Refreshing network info cache for port 30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:45:03.559594 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:03.823404 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:03.944055 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updated VIF entry in instance network info cache for port 30b1ac61-97a8-4b92-9992-446de7a24f43. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:45:03.944317 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating instance_info_cache with network_info: [{"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:04.446377 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-82ad7f8a-1317-4940-86a5-550738fad991 req-3184a448-e85d-4d1e-883f-0008b1f80f4d service nova] Releasing lock "refresh_cache-74356c4e-25ee-427f-adb6-c467cf34ac97" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:45:06.200400 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:06.556646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:11.202288 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:11.557495 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:15.841758 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:16.204155 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:16.558955 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:17.559275 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:17.559727 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:18.060908 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:45:18.603442 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:18.603866 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:18.606705 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:45:18.606828 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Claim successful on node np0000000747
May 14 04:45:19.803827 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:45:19.804155 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:45:20.306878 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:45:20.814635 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.211s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:20.815084 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:45:21.204973 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:21.321017 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:45:21.321397 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:45:21.321691 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:21.321883 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:21.408476 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0386f2a607ee4edda3d9a711ce02eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7eb6509a24d34807cf5fb11dcb7ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:45:21.561787 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:21.809016 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Successfully created port: ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:45:21.827013 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:45:22.255965 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Successfully updated port: ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:45:22.330120 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:45:22.343437 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-changed-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:22.343875 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Refreshing instance network info cache due to event network-changed-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:45:22.344018 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] Acquiring lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:45:22.344099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] Acquired lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:45:22.344198 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Refreshing network info cache for port ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:45:22.757701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:45:22.833838 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Booting with volume e329cd3f-b6fa-4262-8bdc-147d274cc42f at /dev/vda
May 14 04:45:22.847474 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:22.866169 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:45:22.879928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:45:22.900163 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:22.917174 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:45:22.943450 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:45:22.943724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:45:22.953883 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:45:22.955361 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fec5:e72', 'fe80::a495:1eff:fe1e:d316', 'fe80::fc16:3eff:fe09:4f9b', 'fe80::fc16:3eff:feee:93dc', 'fe80::bcf6:4dff:fe6d:cf5c'] 
May 14 04:45:22.955361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:45:22.955361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:45:22.955361 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:45:22.955361 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating existing volume attachment record: b51cf911-33a5-4782-8305-f7db83f18fb1 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:45:23.046329 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:23.548661 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-a83deaf8-66f3-429e-a54e-8400f5d27f8b req-df87dba9-7c29-41b7-8d44-41fd7c91d53b service nova] Releasing lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:45:23.549324 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquired lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:45:23.549560 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:45:24.111674 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:45:24.248216 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:24.362610 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating instance_info_cache with network_info: [{"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:24.601861 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:24.602142 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:45:24.864701 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Releasing lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:45:24.864896 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance network_info: |[{"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:45:25.037853 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:45:25.038852 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:45:25.039056 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Creating image(s)
May 14 04:45:25.039343 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Did not create local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 14 04:45:25.039441 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Ensure instance console log exists: /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:45:25.039656 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:25.039842 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:25.039940 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:25.040334 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Start _get_guest_xml network_info=[{"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b51cf911-33a5-4782-8305-f7db83f18fb1', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fab239dc-710b-45fc-af88-1c70b0ede2d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'serial': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:45:25.044210 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:45:25.045092 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-692995119', uuid='fab239dc-710b-45fc-af88-1c70b0ede2d7'), owner=OwnerMeta(userid='0386f2a607ee4edda3d9a711ce02eeee', username='tempest-TestVolumeBootPatternV346-645608592-project-member', projectid='cce7eb6509a24d34807cf5fb11dcb7ba', projectname='tempest-TestVolumeBootPatternV346-645608592'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778733925.0448258) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:45:25.046171 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:45:25.046457 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:45:25.047456 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:45:25.047594 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:45:25.048367 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:45:25.048587 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:45:25.048729 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:45:25.048809 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:45:25.048913 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:45:25.048987 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:45:25.049070 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:45:25.049206 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:45:25.049309 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:45:25.049408 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:45:25.049496 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:45:25.049596 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:45:25.058885 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:45:25.059161 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:45:25.059267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:25.059567 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:25.059777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:45:25.072337 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:25.073003 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:25.073422 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:25.073660 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:45:25.074083 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:25.074354 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:45:25.083772 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:45:25.083772 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:25.088478 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:45:25.088478 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:25.098247 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f] added
May 14 04:45:25.098247 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:45:25.098247 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:25.098247 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:25.098247 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:25.098247 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:25.098247 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:25.098421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:45:25.098607 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:45:25.098761 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:45:25.099936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f] added
May 14 04:45:25.099936 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:45:25.099936 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:25.099936 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:25.099936 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:25.099936 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:25.099936 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:25.100066 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:45:25.100205 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:45:25.100337 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:45:26.099160 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:45:26.100607 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:45:26.114084 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:45:26.114084 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:45:26.119033 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:45:26.119033 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.127936 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.134501 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.143779 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.143779 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.143779 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.143779 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.143779 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:26.144004 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.144004 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.144004 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.144004 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.144004 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:26.150473 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.150473 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.150473 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.150473 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.150473 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:26.150690 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.150690 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.150690 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.150690 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.150690 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:26.180847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.50.100,3260]
May 14 04:45:26.180847 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.50.100,3260] successful.
May 14 04:45:26.180847 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.191568 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.195500 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.40.100,3260]
May 14 04:45:26.195500 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.40.100,3260] successful.
May 14 04:45:26.195500 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.205736 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:26.206162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:26.206162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:45:26.206405 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:26.206908 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:26.210267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('7', '-', '-', 0) found on session 215 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:45:26.210435 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.220559 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:26.220776 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:26.220956 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:26.221024 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:45:26.221601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] HCTL ('8', '-', '-', 0) found on session 216 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:45:26.221724 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:45:26.226156 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 215 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:26.226373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:45:26.235090 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 216 and hctl ['8', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:26.562833 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:27.234162 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Searching for a device in session 216 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:27.234645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:45:27.609726 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:27.609978 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:27.610166 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:28.090508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Found WWN 330000000c54e5a9f for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:45:28.090852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:28.091064 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000c54e5a9f', 'path': '/dev/dm-0', 'multipath_id': '330000000c54e5a9f'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:45:28.091261 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c54e5a9f', 'path': '/dev/dm-0', 'multipath_id': '330000000c54e5a9f'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:45:28.114397 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:28.114680 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:28.114785 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:28.114935 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:45:28.596896 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-692995119',display_name='tempest-TestVolumeBootPatternV346-server-692995119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-692995119',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGf8N4qQA8XjamOdL06YpSIosHRE9IhL985cDlmgrX6zJux/y5tEiTPwlKIQPlEle0BYk99xtX05DHuhRmkbtOsMQoM4Lgd/HCEGviVJt+77iUHt5daOVzuTub6+cbPtQ==',key_name='tempest-keypair-587457277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-jfuzq03q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:45:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=fab239dc-710b-45fc-af88-1c70b0ede2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:45:28.597676 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:45:28.597982 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:45:28.598809 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'pci_devices' on Instance uuid fab239dc-710b-45fc-af88-1c70b0ede2d7 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:45:29.101859 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] End _get_guest_xml xml=<domain type="qemu">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <uuid>fab239dc-710b-45fc-af88-1c70b0ede2d7</uuid>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <name>instance-00000050</name>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:name>tempest-TestVolumeBootPatternV346-server-692995119</nova:name>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:45:25</nova:creationTime>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:image uuid="">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:user uuid="0386f2a607ee4edda3d9a711ce02eeee">tempest-TestVolumeBootPatternV346-645608592-project-member</nova:user>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:project uuid="cce7eb6509a24d34807cf5fb11dcb7ba">tempest-TestVolumeBootPatternV346-645608592</nova:project>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:root type="volume" uuid=""/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         <nova:port uuid="ee9811e1-fa87-4709-b43b-51b1e4a6f9a5">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <system>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="serial">fab239dc-710b-45fc-af88-1c70b0ede2d7</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="uuid">fab239dc-710b-45fc-af88-1c70b0ede2d7</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </system>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <os>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </os>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <features>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </features>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   <devices>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/disk.config"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </disk>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <alias name="ua-e329cd3f-b6fa-4262-8bdc-147d274cc42f"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <serial>e329cd3f-b6fa-4262-8bdc-147d274cc42f</serial>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </disk>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:62:a0:1f"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <target dev="tapee9811e1-fa"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </interface>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/console.log" append="off"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </serial>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <video>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </video>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </rng>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:   </devices>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]: </domain>
May 14 04:45:29.101859 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Preparing to wait for external event network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-692995119',display_name='tempest-TestVolumeBootPatternV346-server-692995119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-692995119',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGf8N4qQA8XjamOdL06YpSIosHRE9IhL985cDlmgrX6zJux/y5tEiTPwlKIQPlEle0BYk99xtX05DHuhRmkbtOsMQoM4Lgd/HCEGviVJt+77iUHt5daOVzuTub6+cbPtQ==',key_name='tempest-keypair-587457277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-jfuzq03q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:45:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=fab239dc-710b-45fc-af88-1c70b0ede2d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:45:29.103708 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:45:29.104036 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:45:29.104391 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.104923 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:29.105362 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:45:29.106065 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.106314 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddf5a6a5-7f28-5b7e-9348-94d57182887b', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:29.107516 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.108127 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:45:29.109732 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.109911 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee9811e1-fa, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:29.110261 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee9811e1-fa, col_values=(('qos', UUID('6e7c2b74-558f-4363-84fe-e6531ab68cd5')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:29.110432 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee9811e1-fa, col_values=(('external_ids', {'iface-id': 'ee9811e1-fa87-4709-b43b-51b1e4a6f9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a0:1f', 'vm-uuid': 'fab239dc-710b-45fc-af88-1c70b0ede2d7'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:29.111167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.112926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:45:29.116274 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:29.117384 np0000000747 nova-compute[97971]: INFO os_vif [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa')
May 14 04:45:29.135819 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:45:29.136909 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:45:29.137995 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:29.222125 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:45:29.222600 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:29.306363 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:45:29.310980 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:45:29.312202 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:29.356272 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:45:29.356754 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13254MB free_disk=72.59849548339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:45:29.356960 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:29.357208 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:29.374175 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:29.374448 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:29.877999 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:45:30.410761 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance cff8c6a7-d5e1-4115-8690-25399c05f1f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:45:30.410879 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:45:30.410973 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance 74356c4e-25ee-427f-adb6-c467cf34ac97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:45:30.411127 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance fab239dc-710b-45fc-af88-1c70b0ede2d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:45:30.411239 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:45:30.411370 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:45:29 up 45 min,  2 users,  load average: 1.99, 4.38, 4.78\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_cce7eb6509a24d34807cf5fb11dcb7ba': '3', 'io_workload': '1', 'num_proj_9942017b2e7541a3971a106d228bd9d6': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:45:30.597679 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:45:30.597956 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:45:30.631707 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:45:30.631833 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:45:30.631889 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] No VIF found with MAC fa:16:3e:62:a0:1f, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:45:30.632249 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Using config drive
May 14 04:45:30.882721 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:31.102538 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:45:31.138298 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:31.278066 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Creating config drive at /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/disk.config
May 14 04:45:31.282673 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkplvp52n {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:31.341723 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkplvp52n" returned: 0 in 0.059s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:45:31.564375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.611656 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:45:31.612024 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.255s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:31.612366 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:45:31.712727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.729893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.818381 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.830847 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.831487 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:31.861801 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-32763315-611e-49f4-997d-a591008e524a req-79769ff7-5f8d-49bd-926b-937792288dc8 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:31.861908 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-32763315-611e-49f4-997d-a591008e524a req-79769ff7-5f8d-49bd-926b-937792288dc8 service nova] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:31.862055 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-32763315-611e-49f4-997d-a591008e524a req-79769ff7-5f8d-49bd-926b-937792288dc8 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:31.862197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-32763315-611e-49f4-997d-a591008e524a req-79769ff7-5f8d-49bd-926b-937792288dc8 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:31.862308 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-32763315-611e-49f4-997d-a591008e524a req-79769ff7-5f8d-49bd-926b-937792288dc8 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Processing event network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:45:31.938832 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:31.939251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:31.939251 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Attaching volume 7d1778d0-185b-48ef-be67-4cfdfc052c44 to /dev/vdb
May 14 04:45:31.982241 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:45:31.993503 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:45:32.015095 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:45:32.063362 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:45:32.063662 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:45:32.073726 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:45:32.074836 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944', 'fe80::fc16:3eff:fec5:e72', 'fe80::a495:1eff:fe1e:d316', 'fe80::fc16:3eff:fe09:4f9b', 'fe80::fc16:3eff:feee:93dc', 'fe80::bcf6:4dff:fe6d:cf5c', 'fe80::fc16:3eff:fe62:a01f'] 
May 14 04:45:32.074975 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:45:32.075078 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:45:32.075327 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:45:32.075569 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating existing volume attachment record: 7e772b67-33c7-406c-b2aa-6461a60e1085 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:45:32.402966 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733932.402503, fab239dc-710b-45fc-af88-1c70b0ede2d7 => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:45:32.403658 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:45:32.403873 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] VM Started (Lifecycle Event)
May 14 04:45:32.407179 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:45:32.409770 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance spawned successfully.
May 14 04:45:32.410119 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:45:32.621287 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:45:32.621587 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:45:32.621734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:32.622127 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:32.622333 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:45:32.633979 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:32.634526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:32.634911 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:32.635279 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:32.635463 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:45:32.635701 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:45:32.648211 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:45:32.648211 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:32.652682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:45:32.652682 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:32.661117 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44] added
May 14 04:45:32.661117 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:45:32.661117 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:32.661117 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:32.661117 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:32.661117 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:32.661117 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:32.661419 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:45:32.661466 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:45:32.661604 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:45:32.665039 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44] added
May 14 04:45:32.665039 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:45:32.665039 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:32.665039 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:32.665039 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:45:32.665039 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:45:32.665039 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:32.665490 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:45:32.665490 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:45:32.665490 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:45:32.907074 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:32.909370 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:45:32.917928 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:32.918102 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:32.918475 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:32.918770 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:32.919115 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:32.919468 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:45:33.414862 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:45:33.415254 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733933.4148886, fab239dc-710b-45fc-af88-1c70b0ede2d7 => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:45:33.415254 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] VM Paused (Lifecycle Event)
May 14 04:45:33.425591 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Took 8.39 seconds to spawn the instance on the hypervisor.
May 14 04:45:33.425763 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:33.662223 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:45:33.665895 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:45:33.673890 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:45:33.673890 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:45:33.679392 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:45:33.679392 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.686585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.691648 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705221 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705397 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705734 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.705955 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:33.747216 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.40.100,3260]
May 14 04:45:33.747216 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.40.100,3260] successful.
May 14 04:45:33.747216 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.751103 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.50.100,3260]
May 14 04:45:33.751103 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.50.100,3260] successful.
May 14 04:45:33.751103 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.762002 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.766387 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.776109 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.776486 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:33.776486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:33.776843 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:45:33.777585 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('11', '-', '-', 0) found on session 217 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:45:33.777723 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.782084 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:33.782325 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:33.782504 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:33.782562 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:45:33.783421 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] HCTL ('12', '-', '-', 0) found on session 218 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:45:33.783554 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:45:33.793100 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 217 and hctl ['11', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:33.797539 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 218 and hctl ['12', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:33.917773 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:33.920603 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778733933.9203486, fab239dc-710b-45fc-af88-1c70b0ede2d7 => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:45:33.921241 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] VM Resumed (Lifecycle Event)
May 14 04:45:33.927950 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:33.928824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:33.928824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:33.928824 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:33.928936 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] No waiting events found dispatching network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:45:33.929074 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-ff69fb49-f63f-42f6-9e1f-0b0320acd45a req-6ae683a5-6430-4baa-966f-ce04140e4a77 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received unexpected event network-vif-plugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 for instance with vm_state active and task_state None.
May 14 04:45:33.936012 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Took 15.37 seconds to build instance.
May 14 04:45:34.112687 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:34.425161 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:45:34.427077 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:45:34.437632 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-eef0b364-3765-4fbc-b782-bdbfbfbe39de tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.878s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:34.792026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 217 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:34.792264 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:45:34.798093 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Searching for a device in session 218 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:45:34.798334 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:45:35.016645 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-changed-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:35.016645 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Refreshing instance network info cache due to event network-changed-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:45:35.016786 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] Acquiring lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:45:35.016883 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] Acquired lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:45:35.017002 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Refreshing network info cache for port ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:45:35.519116 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:35.636317 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 14 04:45:35.871106 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:35.989331 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updated VIF entry in instance network info cache for port ee9811e1-fa87-4709-b43b-51b1e4a6f9a5. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:45:35.989597 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating instance_info_cache with network_info: [{"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:36.492153 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-f4836a98-ba37-4d68-99da-1dc7659c0b62 req-f7b8466f-1edd-406c-b08e-faa32d60dd79 service nova] Releasing lock "refresh_cache-fab239dc-710b-45fc-af88-1c70b0ede2d7" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:45:36.565871 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:36.611957 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:36.612185 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:36.612377 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:36.612540 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:45:36.612819 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:45:36.653193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found WWN 3300000001e21b9d0 for multipath device dm-9 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:45:36.653434 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:36.653579 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '3300000001e21b9d0', 'path': '/dev/dm-9', 'multipath_id': '3300000001e21b9d0'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:45:36.653711 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001e21b9d0', 'path': '/dev/dm-9', 'multipath_id': '3300000001e21b9d0'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:45:36.656184 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:45:37.158636 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Attempting to attach volume 7d1778d0-185b-48ef-be67-4cfdfc052c44 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=97971) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 14 04:45:37.159803 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] attach device xml: <disk type="block" device="disk">
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <alias name="ua-7d1778d0-185b-48ef-be67-4cfdfc052c44"/>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <serial>7d1778d0-185b-48ef-be67-4cfdfc052c44</serial>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]: </disk>
May 14 04:45:37.159803 np0000000747 nova-compute[97971]:  {{(pid=97971) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 14 04:45:37.610701 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:45:37.611275 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:45:38.799793 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:45:38.800271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:45:38.800271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:45:38.800271 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] No VIF found with MAC fa:16:3e:ee:93:dc, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:45:39.114452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:40.346260 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-9624604f-2386-44f4-8efa-3316914c9e39 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.407s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:40.861780 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:40.861979 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:41.364119 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Detaching volume 7d1778d0-185b-48ef-be67-4cfdfc052c44
May 14 04:45:41.406146 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Attempting to driver detach volume 7d1778d0-185b-48ef-be67-4cfdfc052c44 from mountpoint /dev/vdb
May 14 04:45:41.410732 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-7d1778d0-185b-48ef-be67-4cfdfc052c44 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:45:41.411962 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Found disk vdb by alias ua-7d1778d0-185b-48ef-be67-4cfdfc052c44 {{(pid=97971) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 14 04:45:41.412019 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Attempting to detach device vdb from instance 74356c4e-25ee-427f-adb6-c467cf34ac97 from the persistent domain config. {{(pid=97971) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 14 04:45:41.412295 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <alias name="ua-7d1778d0-185b-48ef-be67-4cfdfc052c44"/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <serial>7d1778d0-185b-48ef-be67-4cfdfc052c44</serial>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]: </disk>
May 14 04:45:41.412295 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:45:41.417689 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 74356c4e-25ee-427f-adb6-c467cf34ac97 from the persistent domain config.
May 14 04:45:41.417829 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] (1/8): Attempting to detach device vdb with device alias ua-7d1778d0-185b-48ef-be67-4cfdfc052c44 from instance 74356c4e-25ee-427f-adb6-c467cf34ac97 from the live domain config. {{(pid=97971) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 14 04:45:41.418100 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.guest [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] detach device xml: <disk type="block" device="disk">
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <alias name="ua-7d1778d0-185b-48ef-be67-4cfdfc052c44"/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <source dev="/dev/dm-9"/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <target dev="vdb" bus="virtio"/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <serial>7d1778d0-185b-48ef-be67-4cfdfc052c44</serial>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <shareable/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]: </disk>
May 14 04:45:41.418100 np0000000747 nova-compute[97971]:  {{(pid=97971) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 14 04:45:41.567045 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:41.962922 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Received event <DeviceRemovedEvent: 1778733941.962552, 74356c4e-25ee-427f-adb6-c467cf34ac97 => ua-7d1778d0-185b-48ef-be67-4cfdfc052c44> from libvirt while the driver is waiting for it; dispatched. {{(pid=97971) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 14 04:45:41.964467 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7d1778d0-185b-48ef-be67-4cfdfc052c44 for instance 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 14 04:45:41.966872 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully detached device vdb from instance 74356c4e-25ee-427f-adb6-c467cf34ac97 from the live domain config.
May 14 04:45:41.996244 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:45:41.996545 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:45:41.996706 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:45:41.997031 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:45:41.997332 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1778d0-185b-48ef-be67-4cfdfc052c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:45:41.997471 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:42.021398 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44 (non-flash)
May 14 04:45:42.021695 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:45:42.021695 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', '218')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:45:42.021920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', '217')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:45:42.022670 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44', '218')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:45:42.023438 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f8594e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'): ({'sdg'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:45:42.023655 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Removing multipathed devices sdf, sdg {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:45:42.023870 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Flush multipath device 3300000001e21b9d0 {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:45:42.053910 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:45:42.098169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:45:42.138022 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:45:42.138183 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:45:42.139395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:45:42.151043 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:45:42.151288 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:45:42.163179 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.205801 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.40.100,3260]
May 14 04:45:42.205801 np0000000747 nova-compute[97971]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.40.100,3260] successful.
May 14 04:45:42.205801 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.221904 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.232461 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.268150 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.50.100,3260]
May 14 04:45:42.268150 np0000000747 nova-compute[97971]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-7d1778d0-185b-48ef-be67-4cfdfc052c44, portal: 192.168.50.100,3260] successful.
May 14 04:45:42.268150 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.285610 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:45:42.285833 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:45:42.285964 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] <== disconnect_volume: return (289ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:45:42.286128 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:45:42.835663 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'flavor' on Instance uuid 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:45:43.840538 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-2b18d22c-af85-43cb-b5f2-b85b52713d15 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.978s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:44.116184 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:45.227267 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:45.227725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:45.227725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:45.227725 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:45.227845 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:45.229582 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Terminating instance
May 14 04:45:45.732094 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:45:45.760398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:45.778176 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:45.797757 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:45.957294 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:45.957730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:45.957904 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:45.958032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:45.958163 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] No waiting events found dispatching network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:45:45.958269 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-17afdb47-2aef-4644-af92-239354b8b072 req-5df0f56c-6b4d-4071-93b9-9135e077c293 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:45:46.038193 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.043886 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.064003 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999748745000034 future=<Future at 0x7435f84d6cc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:45:46.064496 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999021428000106 future=<Future at 0x7435f84d6cc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:45:46.064496 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998819342999923 future=<Future at 0x7435f84d6cc0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:45:46.065192 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Instance destroyed successfully.
May 14 04:45:46.066005 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lazy-loading 'resources' on Instance uuid 74356c4e-25ee-427f-adb6-c467cf34ac97 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:45:46.569079 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.570742 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-942977923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-volumemultiattachtests-server-942977923',id=79,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGAwUjbsK6iEz6PlcGCP01qlyG30exI3mFGICAQLi0oV0PssuUyguU8waP+et+tJ+oN+7/2VIw0/ydGBk3x7AKPrBuYv5bwct8pZ9NNG6wkJeNOGILsYvdIPzpaAtf7sA==',key_name='tempest-keypair-2084449755',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:45:00Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9942017b2e7541a3971a106d228bd9d6',ramdisk_id='',reservation_id='r-3x2dfq08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2142682089',owner_user_name='tempest-VolumeMultiattachTests-2142682089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:45:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='727fba2b300b4d4596102544c1a6d398',uuid=74356c4e-25ee-427f-adb6-c467cf34ac97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:45:46.570946 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converting VIF {"id": "30b1ac61-97a8-4b92-9992-446de7a24f43", "address": "fa:16:3e:ee:93:dc", "network": {"id": "f393b4d5-04f2-44cc-8a44-f242dc4389d0", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-293133207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9942017b2e7541a3971a106d228bd9d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30b1ac61-97", "ovs_interfaceid": "30b1ac61-97a8-4b92-9992-446de7a24f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:45:46.571513 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:45:46.571762 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:45:46.572902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.573135 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30b1ac61-97, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:46.575322 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.576196 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:45:46.576638 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.576776 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=151f9382-e6f8-4ecc-b511-634451523093) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:45:46.577195 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.577635 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:45:46.578496 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:46.580173 np0000000747 nova-compute[97971]: INFO os_vif [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=30b1ac61-97a8-4b92-9992-446de7a24f43,network=Network(f393b4d5-04f2-44cc-8a44-f242dc4389d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30b1ac61-97')
May 14 04:45:46.580459 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Deleting instance files /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97_del
May 14 04:45:46.581173 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Deletion of /opt/stack/data/nova/instances/74356c4e-25ee-427f-adb6-c467cf34ac97_del complete
May 14 04:45:47.087866 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Took 1.36 seconds to destroy the instance on the hypervisor.
May 14 04:45:47.088420 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:45:47.088612 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:45:47.088702 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:45:47.088902 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:47.208523 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:45:47.636364 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-322a0a43-4e48-4802-a787-1f500dc94b8b req-ba729aad-2d0d-4b94-ace2-d6ac1a7bd280 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-deleted-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:47.636752 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-322a0a43-4e48-4802-a787-1f500dc94b8b req-ba729aad-2d0d-4b94-ace2-d6ac1a7bd280 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Neutron deleted interface 30b1ac61-97a8-4b92-9992-446de7a24f43; detaching it from the instance and deleting it from the info cache
May 14 04:45:47.636752 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-322a0a43-4e48-4802-a787-1f500dc94b8b req-ba729aad-2d0d-4b94-ace2-d6ac1a7bd280 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:48.017143 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:45:48.017743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] Acquiring lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:48.017743 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:48.017876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:48.018034 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] No waiting events found dispatching network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:45:48.018159 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-e8b1698e-b0e1-4060-8f6e-43d8f8de3a1b req-e587ee06-5dfc-4ac1-b464-b784bf6ac9f8 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Received event network-vif-unplugged-30b1ac61-97a8-4b92-9992-446de7a24f43 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:45:48.082591 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:45:48.139814 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-322a0a43-4e48-4802-a787-1f500dc94b8b req-ba729aad-2d0d-4b94-ace2-d6ac1a7bd280 service nova] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Detach interface failed, port_id=30b1ac61-97a8-4b92-9992-446de7a24f43, reason: Instance 74356c4e-25ee-427f-adb6-c467cf34ac97 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:45:48.584586 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Took 1.50 seconds to deallocate network for instance.
May 14 04:45:49.090431 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:45:49.091023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:45:49.303329 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:45:49.303519 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:45:49.806161 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:45:50.313956 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.223s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:50.360234 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Deleted allocations for instance 74356c4e-25ee-427f-adb6-c467cf34ac97
May 14 04:45:51.369410 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-fafad995-6a40-40fa-b97d-c317fa540f7a tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Lock "74356c4e-25ee-427f-adb6-c467cf34ac97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.142s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:45:51.570681 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:51.577896 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:53.295580 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:54.791846 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:56.571861 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:45:56.578943 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:01.063701 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00038370699985534884 future=<Future at 0x7435f84d6cc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:01.064122 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:01.065549 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733946.063112, 74356c4e-25ee-427f-adb6-c467cf34ac97 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:46:01.065549 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] VM Stopped (Lifecycle Event)
May 14 04:46:01.568133 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 74356c4e-25ee-427f-adb6-c467cf34ac97] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:46:01.573063 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:01.579281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:06.574868 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:06.579983 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:11.577244 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:11.580281 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:11.782675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:11.782675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:11.782675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:11.782675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:11.782675 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:11.784346 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Terminating instance
May 14 04:46:12.287033 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:46:12.301216 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:12.302754 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:12.317885 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:12.414974 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:12.420434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:12.425825 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:12.425950 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:12.426109 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:12.426198 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:12.426310 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] No waiting events found dispatching network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:12.426414 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-bb37d893-94b5-458d-a42e-aa66f90a5e22 req-4a2cc9b7-6fb2-4bce-9252-03d34d52a1cd service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:12.603268 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.99976618699975 future=<Future at 0x7435f849ba70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:12.604197 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998791591999634 future=<Future at 0x7435f849ba70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:12.604326 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998622668999815 future=<Future at 0x7435f849ba70 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:12.605082 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Instance destroyed successfully.
May 14 04:46:12.605440 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'resources' on Instance uuid fab239dc-710b-45fc-af88-1c70b0ede2d7 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:46:13.108219 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-692995119',display_name='tempest-TestVolumeBootPatternV346-server-692995119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-692995119',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGf8N4qQA8XjamOdL06YpSIosHRE9IhL985cDlmgrX6zJux/y5tEiTPwlKIQPlEle0BYk99xtX05DHuhRmkbtOsMQoM4Lgd/HCEGviVJt+77iUHt5daOVzuTub6+cbPtQ==',key_name='tempest-keypair-587457277',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:45:33Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-jfuzq03q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=fab239dc-710b-45fc-af88-1c70b0ede2d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:46:13.108498 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "address": "fa:16:3e:62:a0:1f", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee9811e1-fa", "ovs_interfaceid": "ee9811e1-fa87-4709-b43b-51b1e4a6f9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:46:13.108972 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:46:13.109217 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:46:13.110131 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.110375 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee9811e1-fa, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:13.111413 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.112082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:13.112367 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.112982 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.113113 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e7c2b74-558f-4363-84fe-e6531ab68cd5) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:13.113514 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.113938 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:13.114110 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:13.115654 np0000000747 nova-compute[97971]: INFO os_vif [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a0:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee9811e1-fa')
May 14 04:46:13.117140 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:46:13.117436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:46:13.117605 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:46:13.117942 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:46:13.118204 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e329cd3f-b6fa-4262-8bdc-147d274cc42f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:46:13.118361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:46:13.140926 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f (non-flash)
May 14 04:46:13.141361 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '216')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:46:13.141361 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '216')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:13.142267 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f', '215')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:13.143033 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84e0c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'): ({'sdb'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:46:13.143260 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:46:13.143530 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flush multipath device 330000000c54e5a9f {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:46:13.190045 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:13.229141 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:13.264151 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:46:13.264316 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:46:13.265294 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:46:13.275986 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:46:13.276218 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:46:13.286452 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.324663 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.40.100,3260]
May 14 04:46:13.324663 np0000000747 nova-compute[97971]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.40.100,3260] successful.
May 14 04:46:13.324663 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.340935 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.352254 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.386818 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.50.100,3260]
May 14 04:46:13.386818 np0000000747 nova-compute[97971]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-e329cd3f-b6fa-4262-8bdc-147d274cc42f, portal: 192.168.50.100,3260] successful.
May 14 04:46:13.386818 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.401026 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:13.401290 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:46:13.401464 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== disconnect_volume: return (283ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:46:13.401657 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:46:13.402020 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Deleting instance files /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7_del
May 14 04:46:13.402801 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Deletion of /opt/stack/data/nova/instances/fab239dc-710b-45fc-af88-1c70b0ede2d7_del complete
May 14 04:46:13.909208 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Took 1.62 seconds to destroy the instance on the hypervisor.
May 14 04:46:13.910333 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:46:13.910632 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:46:13.910738 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:46:13.910957 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:13.979412 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:14.332574 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-afabc59e-65b4-4692-aae5-6964a59f8119 req-37a5f257-fe43-41af-b663-2b5619f843f4 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-deleted-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:14.332913 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-afabc59e-65b4-4692-aae5-6964a59f8119 req-37a5f257-fe43-41af-b663-2b5619f843f4 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Neutron deleted interface ee9811e1-fa87-4709-b43b-51b1e4a6f9a5; detaching it from the instance and deleting it from the info cache
May 14 04:46:14.333350 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-afabc59e-65b4-4692-aae5-6964a59f8119 req-37a5f257-fe43-41af-b663-2b5619f843f4 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:14.483768 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:14.483926 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] Acquiring lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:14.484065 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:14.484176 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:14.484276 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] No waiting events found dispatching network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:14.484382 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-577afcbb-d445-4ac5-86fb-dd67edd69710 req-2423c4f8-607c-41a5-8a10-af6bf1603457 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Received event network-vif-unplugged-ee9811e1-fa87-4709-b43b-51b1e4a6f9a5 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:14.784062 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:14.836551 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-afabc59e-65b4-4692-aae5-6964a59f8119 req-37a5f257-fe43-41af-b663-2b5619f843f4 service nova] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Detach interface failed, port_id=ee9811e1-fa87-4709-b43b-51b1e4a6f9a5, reason: Instance fab239dc-710b-45fc-af88-1c70b0ede2d7 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:46:15.285873 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Took 1.37 seconds to deallocate network for instance.
May 14 04:46:15.829691 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:46:16.334595 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:16.335064 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:16.486937 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:46:16.487116 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:46:16.989393 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:46:17.495668 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.161s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:17.539462 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Deleted allocations for instance fab239dc-710b-45fc-af88-1c70b0ede2d7
May 14 04:46:18.114106 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:18.427566 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:18.547311 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-dd26d8f9-f3db-49e7-af84-c44d1630f7b1 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "fab239dc-710b-45fc-af88-1c70b0ede2d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.765s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:21.485045 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:21.485500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:21.485500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:21.485500 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:21.485605 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:21.488465 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Terminating instance
May 14 04:46:21.991553 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:46:22.005976 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.007440 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.020010 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.117357 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.122518 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.149207 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:22.149574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:22.149861 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:22.149941 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:22.150103 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] No waiting events found dispatching network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:22.150247 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-30e9d46e-10c8-4d9f-9717-7a7135c8c776 req-6f3b6836-b9d0-4700-b033-26b5b1b18da5 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:22.303902 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999695375000101 future=<Future at 0x7435f84541d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:22.306119 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Instance destroyed successfully.
May 14 04:46:22.306436 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'resources' on Instance uuid 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:46:22.808927 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1850629351',display_name='tempest-TestVolumeBootPatternV346-server-1850629351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1850629351',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmxUlJ8ptfwW3WlOOmIFucZQqi3d7b6I2C9wvamNpRVPMSwd1WSylmIUEf02tJ+b8vzh+lXWWt3mkZN43l1dUoT8SmW93HyxvMyCvNzOi8d7AOBexlRZqzP4nllHWJW+w==',key_name='tempest-keypair-1648393332',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:44:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-kmluv4qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:46:22.809333 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "6804e553-0520-4ccc-8c1d-77a811387a83", "address": "fa:16:3e:09:4f:9b", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6804e553-05", "ovs_interfaceid": "6804e553-0520-4ccc-8c1d-77a811387a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:46:22.809855 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:46:22.810150 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:46:22.811224 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.811460 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6804e553-05, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:22.812508 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.813398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:22.814166 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.814295 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d732de4-a2e9-4fe1-af3d-976b363d09fa) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:22.814904 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:22.815377 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:22.817511 np0000000747 nova-compute[97971]: INFO os_vif [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:9b,bridge_name='br-int',has_traffic_filtering=True,id=6804e553-0520-4ccc-8c1d-77a811387a83,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6804e553-05')
May 14 04:46:22.819121 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:46:22.819469 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:46:22.819678 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:46:22.820067 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:46:22.820424 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e85da25-bed4-45be-8c3f-094734d859bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:46:22.820743 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:46:22.843298 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:22.843298 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:22.843298 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:22.843298 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:22.843298 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:46:22.843482 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:22.843482 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:22.843482 np0000000747 nova-compute[97971]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:22.843482 np0000000747 nova-compute[97971]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd (non-flash)
May 14 04:46:22.843482 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:46:22.843601 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:46:22.843764 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '213')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:22.844774 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd', '214')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:22.845603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x74361bfa8a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'): ({'sdi'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:46:22.845853 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Removing multipathed devices sdh, sdi {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:46:22.846114 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flush multipath device 330000000c0e04dae {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:46:22.896008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:22.947110 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:22.978851 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:46:22.979044 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:46:22.979799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:46:22.989647 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:46:22.989782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:46:22.999972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.029813 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.40.100,3260]
May 14 04:46:23.029813 np0000000747 nova-compute[97971]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.40.100,3260] successful.
May 14 04:46:23.029813 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.044193 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.054154 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.084558 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.50.100,3260]
May 14 04:46:23.084558 np0000000747 nova-compute[97971]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-6e85da25-bed4-45be-8c3f-094734d859bd, portal: 192.168.50.100,3260] successful.
May 14 04:46:23.084558 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.095921 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:23.096116 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:46:23.096206 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== disconnect_volume: return (276ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:46:23.096340 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:46:23.096588 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Deleting instance files /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533_del
May 14 04:46:23.097072 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Deletion of /opt/stack/data/nova/instances/73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533_del complete
May 14 04:46:23.602863 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Took 1.61 seconds to destroy the instance on the hypervisor.
May 14 04:46:23.603406 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:46:23.603766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:46:23.603901 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:46:23.604151 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:23.666835 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:24.088431 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6840ee23-a0c5-4e1b-9912-dca03fb99f46 req-e9020bda-e331-48e1-8b18-b54b5f25369f service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-deleted-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:24.088796 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-6840ee23-a0c5-4e1b-9912-dca03fb99f46 req-e9020bda-e331-48e1-8b18-b54b5f25369f service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Neutron deleted interface 6804e553-0520-4ccc-8c1d-77a811387a83; detaching it from the instance and deleting it from the info cache
May 14 04:46:24.088847 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-6840ee23-a0c5-4e1b-9912-dca03fb99f46 req-e9020bda-e331-48e1-8b18-b54b5f25369f service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:24.202386 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:24.202835 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] Acquiring lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:24.202990 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:24.203107 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:24.203222 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] No waiting events found dispatching network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:24.203325 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-7f7e3a58-c2c0-4dde-bdd2-93d83eadd630 req-6b74df52-46e8-4bda-b816-dc3712b113f2 service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Received event network-vif-unplugged-6804e553-0520-4ccc-8c1d-77a811387a83 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:24.485132 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:24.593132 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-6840ee23-a0c5-4e1b-9912-dca03fb99f46 req-e9020bda-e331-48e1-8b18-b54b5f25369f service nova] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Detach interface failed, port_id=6804e553-0520-4ccc-8c1d-77a811387a83, reason: Instance 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:46:24.601582 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:24.601867 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:24.986902 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Took 1.38 seconds to deallocate network for instance.
May 14 04:46:25.536275 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Took 0.55 seconds to detach 1 volumes for instance.
May 14 04:46:26.040660 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:26.040822 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:26.154700 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:46:26.154886 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:46:26.657779 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:46:27.163269 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.122s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:27.209453 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Deleted allocations for instance 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533
May 14 04:46:27.603339 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003436560000409372 future=<Future at 0x7435f849ba70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:27.603684 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733972.6028988, fab239dc-710b-45fc-af88-1c70b0ede2d7 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:46:27.603807 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:27.603952 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] VM Stopped (Lifecycle Event)
May 14 04:46:27.604706 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.698862530000042 future=<Future at 0x7435f84541d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:27.604790 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.698768436000137 future=<Future at 0x7435f84541d0 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:27.609784 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:27.610093 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:27.815753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:28.106406 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-68c9cf0f-8b27-4398-a07a-bb6f6b1432f5 tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: fab239dc-710b-45fc-af88-1c70b0ede2d7] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:46:28.216251 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-8b0a090b-79a2-4fb6-9a11-d29256805005 tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.731s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:28.610085 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:28.610333 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:29.609802 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:30.113337 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:30.113489 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:30.113671 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:30.113802 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:46:30.943776 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:30.944126 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:30.944235 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:30.944413 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:30.944527 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:30.946975 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Terminating instance
May 14 04:46:31.130705 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=97971) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 14 04:46:31.132271 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:46:31.132986 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:46:31.179236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:46:31.179534 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=13997MB free_disk=72.6083755493164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:46:31.179726 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:31.179997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:31.450369 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:46:31.465533 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:31.482175 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:31.484452 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:31.494520 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:31.501116 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:31.593476 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:31.594032 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:31.594663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:31.594663 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:31.594663 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] No waiting events found dispatching network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:31.594813 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2a1b1cfc-a6d6-4691-9785-7664cc64641f req-0d19acba-08bb-4af6-b281-7fd669add858 service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:31.755801 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999571656999706 future=<Future at 0x743618284320 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:31.757075 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Instance destroyed successfully.
May 14 04:46:31.758376 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lazy-loading 'resources' on Instance uuid cff8c6a7-d5e1-4115-8690-25399c05f1f8 {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:46:32.230164 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance cff8c6a7-d5e1-4115-8690-25399c05f1f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:46:32.230472 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:46:32.230472 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:46:31 up 47 min,  2 users,  load average: 1.23, 3.73, 4.53\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_deleting': '1', 'num_os_type_None': '1', 'num_proj_cce7eb6509a24d34807cf5fb11dcb7ba': '1', 'io_workload': '0'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:46:32.260096 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1301668444',display_name='tempest-TestVolumeBootPatternV346-server-1301668444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-testvolumebootpatternv346-server-1301668444',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPe583jmKB8ykHpSlLlmxU2AM97pkfgVXLlpOGrzYZq/RyuWPsD2pUKkOLC8l6F6HrHV76s4Ir2SJrFODmrvMqufXTJUkEizpeCRiSZkorJXjTF7xb78k+CLg6ep7UIIg==',key_name='tempest-keypair-491463117',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:43:34Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cce7eb6509a24d34807cf5fb11dcb7ba',ramdisk_id='',reservation_id='r-4jppdt4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-645608592',owner_user_name='tempest-TestVolumeBootPatternV346-645608592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0386f2a607ee4edda3d9a711ce02eeee',uuid=cff8c6a7-d5e1-4115-8690-25399c05f1f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:46:32.260253 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converting VIF {"id": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "address": "fa:16:3e:c5:0e:72", "network": {"id": "9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-467561193-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cce7eb6509a24d34807cf5fb11dcb7ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe965eb0-c5", "ovs_interfaceid": "fe965eb0-c55d-4b0a-bba4-95a91a84e997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:46:32.260840 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:46:32.261050 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:46:32.263485 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:32.263703 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe965eb0-c5, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:32.264625 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:32.265305 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:32.265725 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:32.266313 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:32.266421 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab4d0b4e-56f5-4012-827e-7c16b0e137d5) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:46:32.267101 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:32.267982 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:32.271972 np0000000747 nova-compute[97971]: INFO os_vif [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:0e:72,bridge_name='br-int',has_traffic_filtering=True,id=fe965eb0-c55d-4b0a-bba4-95a91a84e997,network=Network(9ad8c5c1-6d71-447b-b4d3-ce0fc2867c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe965eb0-c5')
May 14 04:46:32.273369 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:46:32.273711 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:46:32.273834 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:46:32.274143 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:46:32.274397 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:46:32.274528 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:46:32.293526 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:32.293526 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:32.293526 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:46:32.293777 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:32.293777 np0000000747 nova-compute[97971]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7 (non-flash)
May 14 04:46:32.293777 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:46:32.293847 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:46:32.293922 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '205')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:32.294671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7', '206')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:46:32.295682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84bb1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'): ({'sde'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:46:32.295682 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Removing multipathed devices sde, sdd {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:46:32.295920 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Flush multipath device 3300000004305324c {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:46:32.313351 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:46:32.313351 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:46:32.340878 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:32.386966 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:46:32.425863 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:46:32.425997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] SCSI volumes sde, sdd have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:46:32.426654 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:46:32.437015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:46:32.437015 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:46:32.446476 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.474301 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.40.100,3260]
May 14 04:46:32.474301 np0000000747 nova-compute[97971]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.40.100,3260] successful.
May 14 04:46:32.474301 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.486673 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.496523 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.519136 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.50.100,3260]
May 14 04:46:32.519136 np0000000747 nova-compute[97971]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-612a1a18-bad1-4a2a-99e1-ed2bb21316f7, portal: 192.168.50.100,3260] successful.
May 14 04:46:32.519136 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.529698 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:46:32.529972 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:46:32.530088 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] <== disconnect_volume: return (256ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:46:32.530250 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:46:32.530457 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Deleting instance files /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8_del
May 14 04:46:32.530988 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Deletion of /opt/stack/data/nova/instances/cff8c6a7-d5e1-4115-8690-25399c05f1f8_del complete
May 14 04:46:32.815428 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:46:33.036450 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Took 1.59 seconds to destroy the instance on the hypervisor.
May 14 04:46:33.037039 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:46:33.037330 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:46:33.037435 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:46:33.037763 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:33.091528 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:46:33.322333 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:46:33.323042 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.142s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:33.323042 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:33.648847 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:33.649197 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] Acquiring lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:33.649356 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:33.649493 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:33.649642 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] No waiting events found dispatching network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:46:33.649766 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-unplugged-fe965eb0-c55d-4b0a-bba4-95a91a84e997 for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:46:33.649873 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Received event network-vif-deleted-fe965eb0-c55d-4b0a-bba4-95a91a84e997 {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:46:33.649984 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Neutron deleted interface fe965eb0-c55d-4b0a-bba4-95a91a84e997; detaching it from the instance and deleting it from the info cache
May 14 04:46:33.650095 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:33.926608 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:46:34.153102 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-18d13135-36da-4e2c-96eb-dfdf199310e0 req-8d51b416-59ea-4359-beae-27bcaaf1224e service nova] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Detach interface failed, port_id=fe965eb0-c55d-4b0a-bba4-95a91a84e997, reason: Instance cff8c6a7-d5e1-4115-8690-25399c05f1f8 could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:46:34.314559 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:34.314731 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:34.314906 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:34.315135 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.29 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:34.428396 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Took 1.39 seconds to deallocate network for instance.
May 14 04:46:34.969469 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:46:35.474236 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:46:35.474850 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:46:35.558985 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:46:35.559232 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:46:35.591086 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:35.609878 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:35.610053 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:46:35.610292 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:36.061806 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:46:36.567988 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.093s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:36.620222 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Deleted allocations for instance cff8c6a7-d5e1-4115-8690-25399c05f1f8
May 14 04:46:37.273110 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:37.273350 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:46:37.273438 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:46:37.273509 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:46:37.283063 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:37.283325 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:46:37.304040 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.00042977900011464953 future=<Future at 0x7435f84541d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:37.304432 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733982.3035033, 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:46:37.304587 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:37.304763 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] VM Stopped (Lifecycle Event)
May 14 04:46:37.304870 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.450479443999939 future=<Future at 0x743618284320 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:37.305818 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=9.449529244999667 future=<Future at 0x743618284320 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:37.628915 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-bf0d06b3-5d4c-4017-b578-1bb1b8dfa40a tempest-TestVolumeBootPatternV346-645608592 tempest-TestVolumeBootPatternV346-645608592-project-member] Lock "cff8c6a7-d5e1-4115-8690-25399c05f1f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.685s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:46:37.807077 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: 73d3174b-8a0d-4ec1-9ea7-dbb53cf2d533] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:46:39.610393 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:46:39.610816 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:46:39.895503 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:41.319234 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:42.284283 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:44.384753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:46.276467 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:46.581211 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:46.755734 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003600869999900169 future=<Future at 0x743618284320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:46.756214 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] Emitting event <LifecycleEvent: 1778733991.7552645, cff8c6a7-d5e1-4115-8690-25399c05f1f8 => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:46:46.756376 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:46:46.756520 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] VM Stopped (Lifecycle Event)
May 14 04:46:47.258877 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-e789090f-5988-4f48-951e-4e131fd960ef tempest-VolumeMultiattachTests-2142682089 tempest-VolumeMultiattachTests-2142682089-project-member] [instance: cff8c6a7-d5e1-4115-8690-25399c05f1f8] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:46:47.301981 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:51.582542 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:52.303659 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:56.583468 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:46:57.305530 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:01.584802 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:02.307781 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:07.323326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:07.323326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:07.323326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:47:07.323326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:07.323815 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:07.323841 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:12.324315 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:17.329684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:17.330022 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:17.330022 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:47:17.330022 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:17.336482 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:17.336668 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:22.337116 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:24.601689 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:24.602117 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:27.338630 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:27.609640 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:27.609918 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:30.609863 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:30.610362 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:31.114331 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:47:31.114522 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:47:31.114574 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:47:31.114705 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:47:31.125896 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:47:31.126641 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:47:31.173859 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:47:31.174203 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=14160MB free_disk=72.60446166992188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:47:31.174369 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:47:31.174588 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:47:32.232531 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:47:32.232882 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:47:31 up 48 min,  2 users,  load average: 1.18, 3.25, 4.31\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:47:32.274947 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:47:32.275265 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:47:32.339821 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:32.777972 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:47:33.286171 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:47:33.286795 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.112s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:47:33.286795 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.32 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:33.610272 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:33.610535 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:33.610705 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=97971) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 14 04:47:34.112629 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:36.111731 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:36.112196 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:36.609874 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:36.610016 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:47:36.610288 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:37.341779 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:41.610307 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:41.610832 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:42.343484 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:42.610244 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:42.610389 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Cleaning up deleted instances {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 14 04:47:43.113301 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] There are 0 instances to clean {{(pid=97971) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 14 04:47:43.113531 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:47.348902 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:47.349339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:47:47.349339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:47:47.349339 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:47.359579 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:47.359826 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:47:52.360398 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:47:53.610579 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:47:54.111967 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:47:57.362853 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:02.363844 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:07.365100 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:12.366852 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:17.369149 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:18.538608 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:20.598102 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:20.598505 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:21.100832 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Starting instance... {{(pid=97971) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 14 04:48:21.719523 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:21.719909 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:21.722701 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=97971) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 14 04:48:21.722833 np0000000747 nova-compute[97971]: INFO nova.compute.claims [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Claim successful on node np0000000747
May 14 04:48:22.370036 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:22.766369 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Refreshing inventories for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 14 04:48:22.802686 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Updating ProviderTree inventory for provider 31f323e6-64de-412b-a8c9-20c9194ab897 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 14 04:48:22.802830 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Updating inventory in ProviderTree for provider 31f323e6-64de-412b-a8c9-20c9194ab897 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 14 04:48:22.839140 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Refreshing aggregate associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, aggregates: None {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 14 04:48:22.879905 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Refreshing trait associations for resource provider 31f323e6-64de-412b-a8c9-20c9194ab897, traits: COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE,COMPUTE_SOUND_MODEL_PCSPK,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_ARCH_MIPSEL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ACCELERATORS {{(pid=97971) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 14 04:48:22.955634 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:48:22.955894 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:48:23.458137 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:48:23.963633 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.244s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:23.964127 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Start building networks asynchronously for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 14 04:48:24.469845 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Allocating IP information in the background. {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 14 04:48:24.470304 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] allocate_for_instance() {{(pid=97971) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 14 04:48:24.470705 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:24.470985 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:24.542263 np0000000747 nova-compute[97971]: DEBUG nova.policy [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b0c1ee4f0d24495920acef8029edf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28bf0fd9b8a45d78b47fc5f8b0dea82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97971) authorize /opt/stack/nova/nova/policy.py:192}}
May 14 04:48:24.909495 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Successfully created port: a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 14 04:48:24.970786 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 14 04:48:25.103013 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:25.103285 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.51 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:25.309493 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Successfully updated port: a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 14 04:48:25.355244 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-changed-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:48:25.355317 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Refreshing instance network info cache due to event network-changed-a6cc9112-90af-4c19-aba2-5cf4313e8cdc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:48:25.355486 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] Acquiring lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:48:25.355653 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] Acquired lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:48:25.355903 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Refreshing network info cache for port a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:48:25.811118 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:48:25.857760 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:25.919013 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:48:25.976568 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Start building block device mappings for instance. {{(pid=97971) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 14 04:48:26.036905 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:48:26.481073 np0000000747 nova-compute[97971]: INFO nova.virt.block_device [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Booting with volume c4b91e00-4230-487f-bca1-72f79e9910fd at /dev/vdb
May 14 04:48:26.516936 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.176', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000747', 'execute': None}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:48:26.527008 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.scaleio [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=97971) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 14 04:48:26.538570 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-8d8a306d-2be3-4f10-9502-f632723c7fda req-445477da-5add-4611-add4-16085f40d156 service nova] Releasing lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:48:26.538997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquired lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:48:26.539155 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Building network info cache for instance {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 14 04:48:26.549711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): nvme version {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:26.596001 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] 'nvme version' failed. Not Retrying. {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 14 04:48:26.596276 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.nvmeof [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] nvme not present on system {{(pid=97971) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 14 04:48:26.605391 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=97971) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 14 04:48:26.606263 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.lightos [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Current host hostNQN  and IP(s) are ['10.4.3.176', 'fe80::f816:3eff:feaa:c00a', '192.168.40.6', 'fe80::f816:3eff:fe87:3ec2', '192.168.50.6', 'fe80::f816:3eff:fe8c:a27', '192.168.10.6', 'fe80::f816:3eff:fe95:e1b4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::747a:c3ff:fe14:944'] 
May 14 04:48:26.606386 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 14 04:48:26.606486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.lightos [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] LIGHTOS: no hostnqn found. {{(pid=97971) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 14 04:48:26.606745 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.176', 'host': 'np0000000747', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4bd2750304', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '858f6015-de81-42a7-a25c-7f7b0ad765b9', 'nvme_native_multipath': False} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:48:26.606955 np0000000747 nova-compute[97971]: DEBUG nova.virt.block_device [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating existing volume attachment record: 28edf1bf-2210-4655-bf95-c6bcb07ad343 {{(pid=97971) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 14 04:48:27.092600 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance cache missing network info. {{(pid=97971) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 14 04:48:27.225886 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:27.337637 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating instance_info_cache with network_info: [{"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:48:27.372996 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:48:27.373217 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:48:27.373286 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:48:27.373325 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:48:27.378050 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:27.378267 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:48:27.839473 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Releasing lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:48:27.839815 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance network_info: |[{"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=97971) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 14 04:48:28.696222 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Start spawning the instance on the hypervisor. {{(pid=97971) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 14 04:48:28.697214 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Creating instance directory {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 14 04:48:28.697425 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Creating image(s)
May 14 04:48:28.697939 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:28.698134 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:28.698934 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:28.699380 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:48:28.702016 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:48:28.703174 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:28.795343 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.092s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:28.796696 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "dba6e9558af9067da11f683051c8a71c99d94155" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:28.797222 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:28.797768 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:48:28.800657 np0000000747 nova-compute[97971]: DEBUG oslo_utils.imageutils.format_inspector [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=97971) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 14 04:48:28.801418 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:28.888371 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:28.889094 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk 1073741824 {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:28.941672 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155,backing_fmt=raw /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk 1073741824" returned: 0 in 0.052s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:28.942213 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "dba6e9558af9067da11f683051c8a71c99d94155" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:28.942600 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:29.025857 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dba6e9558af9067da11f683051c8a71c99d94155 --force-share --output=json" returned: 0 in 0.083s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:29.026293 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk. size=1073741824 {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 14 04:48:29.026530 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk --force-share --output=json {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:29.113914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:29.114367 np0000000747 nova-compute[97971]: DEBUG nova.virt.disk.api [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Cannot resize image /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk to a smaller size. {{(pid=97971) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 14 04:48:29.114863 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Created local disks {{(pid=97971) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 14 04:48:29.115058 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/console.log {{(pid=97971) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 14 04:48:29.115345 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:29.115587 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:29.115767 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:29.118359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Start _get_guest_xml network_info=[{"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'image_id': '61ff7b79-8a72-479d-a718-78041e1efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '28edf1bf-2210-4655-bf95-c6bcb07ad343', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'boot_index': -1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd2b5c567-0368-42b9-b7f6-b3714fb73b2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'serial': 'c4b91e00-4230-487f-bca1-72f79e9910fd'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 14 04:48:29.122708 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:48:29.124148 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61ff7b79-8a72-479d-a718-78041e1efa4d', instance_meta=NovaInstanceMeta(name='tempest-instance-248276871', uuid='d2b5c567-0368-42b9-b7f6-b3714fb73b2f'), owner=OwnerMeta(userid='6b0c1ee4f0d24495920acef8029edf57', username='tempest-VolumesBackupsTest-184829899-project-member', projectid='f28bf0fd9b8a45d78b47fc5f8b0dea82', projectname='tempest-VolumesBackupsTest-184829899'), image=ImageMeta(id='61ff7b79-8a72-479d-a718-78041e1efa4d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778734109.1237903) {{(pid=97971) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 14 04:48:29.125359 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V1... {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 14 04:48:29.125708 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CPU controller missing on host. {{(pid=97971) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 14 04:48:29.126652 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Searching host: 'np0000000747' for CPU controller through CGroups V2... {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 14 04:48:29.126838 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.host [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CPU controller found on host. {{(pid=97971) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 14 04:48:29.127785 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=97971) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 14 04:48:29.128100 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-14T04:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-14T04:22:33Z,direct_url=<?>,disk_format='qcow2',id=61ff7b79-8a72-479d-a718-78041e1efa4d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='8e7eb0b9d8d84d1f8c1561e0869460a1',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-14T04:22:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 14 04:48:29.128241 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Flavor limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 14 04:48:29.128330 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Image limits 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 14 04:48:29.128445 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Flavor pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 14 04:48:29.128525 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Image pref 0:0:0 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 14 04:48:29.128663 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 14 04:48:29.128838 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 14 04:48:29.128938 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 14 04:48:29.129035 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Got 1 possible topologies {{(pid=97971) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 14 04:48:29.129148 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 14 04:48:29.129262 np0000000747 nova-compute[97971]: DEBUG nova.virt.hardware [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=97971) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 14 04:48:29.140341 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Calling os-brick to attach iSCSI Volume {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 14 04:48:29.140722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:48:29.140927 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:48:29.141339 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:48:29.141524 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 14 04:48:29.153169 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:48:29.153931 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:48:29.154486 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:48:29.155673 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:48:29.156132 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:48:29.156441 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:48:29.165931 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:48:29.165931 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:29.170187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 14 04:48:29.170187 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:29.175665 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd] added
May 14 04:48:29.175665 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:48:29.175665 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:48:29.175665 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:48:29.175665 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:48:29.175665 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:48:29.175665 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:29.175928 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:48:29.175977 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:48:29.176122 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:48:29.182187 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd] added
May 14 04:48:29.182187 np0000000747 nova-compute[97971]:  stderr=iscsiadm: Config file line 363 does not have value
May 14 04:48:29.182187 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:48:29.182187 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:48:29.182187 np0000000747 nova-compute[97971]: iscsiadm: Config file line 363 does not have value
May 14 04:48:29.182187 np0000000747 nova-compute[97971]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 14 04:48:29.182187 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:29.182365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=97971) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 14 04:48:29.182465 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 14 04:48:29.182606 np0000000747 nova-compute[97971]: DEBUG os_brick.utils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=97971) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 14 04:48:29.609838 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:29.610174 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:30.176631 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 14 04:48:30.183023 np0000000747 nova-compute[97971]: INFO os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.40.100
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:48:30.189065 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:48:30.189065 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.name = iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.tpgt = -1
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.startup = manual
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.leading_login = No
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.iscsi_ifacename = default
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.net_ifacename = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.ipaddress = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.prefix_len = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.hwaddress = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.transport_name = tcp
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.initiatorname = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.vlan_id = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.vlan_priority = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.vlan_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.iface_num = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.mtu = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.port = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.bootproto = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.subnet_mask = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.gateway = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_alt_client_id = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_dns = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_learn_iqn = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_req_vendor_id_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_vendor_id = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.dhcp_slp_da = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.fragmentation = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.gratuitous_arp = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.incoming_forwarding = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tos_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tos = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.ttl = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.delayed_ack = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tcp_nagle = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tcp_wsf_state = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tcp_wsf = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tcp_timer_scale = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.tcp_timestamp = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.redirect = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.def_task_mgmt_timeout = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.header_digest = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.data_digest = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.immediate_data = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.initial_r2t = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.data_seq_inorder = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.data_pdu_inorder = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.erl = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.max_receive_data_len = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.first_burst_len = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.max_outstanding_r2t = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.max_burst_len = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.chap_auth = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.bidi_chap = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.strict_login_compliance = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.discovery_auth = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: iface.discovery_logout = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.discovery_address = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.discovery_port = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.discovery_type = fw
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.initial_cmdsn = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.initial_login_retry_max = 8
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.xmit_thread_priority = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.cmds_max = 128
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.queue_depth = 32
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.nr_sessions = 1
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.authmethod = None
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.username = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.password = ***
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.username_in = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.password_in = <empty>
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.auth.chap_algs = SHA256
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.timeo.replacement_timeout = 120
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.err_timeo.abort_timeout = 15
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.err_timeo.lu_reset_timeout = 30
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.err_timeo.tgt_reset_timeout = 30
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.err_timeo.host_reset_timeout = 60
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.FastAbort = Yes
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.InitialR2T = No
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.ImmediateData = Yes
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.FirstBurstLength = 262144
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.MaxBurstLength = 16776192
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Retain = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.DefaultTime2Wait = 2
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.MaxConnections = 1
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.MaxOutstandingR2T = 1
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.iscsi.ERL = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.scan = auto
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.session.reopen_max = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].address = 192.168.50.100
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].port = 3260
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].startup = manual
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].tcp.window_size = 524288
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].tcp.type_of_service = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].timeo.logout_timeout = 15
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].timeo.login_timeout = 15
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].timeo.auth_timeout = 45
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_interval = 5
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].timeo.noop_out_timeout = 5
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.HeaderDigest = None
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.DataDigest = None
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.IFMarker = No
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: node.conn[0].iscsi.OFMarker = No
May 14 04:48:30.194965 np0000000747 nova-compute[97971]: # END RECORD
May 14 04:48:30.194965 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:30.201902 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:30.208624 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:30.213587 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:48:30.213587 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:48:30.213741 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:48:30.213741 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:48:30.213858 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:48:30.213858 np0000000747 nova-compute[97971]: 
May 14 04:48:30.218220 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 14 04:48:30.218220 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:48:30.218628 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 14 04:48:30.218628 np0000000747 nova-compute[97971]:  {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:48:30.218628 np0000000747 nova-compute[97971]: WARNING os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 14 04:48:30.218628 np0000000747 nova-compute[97971]: 
May 14 04:48:30.601668 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:30.601943 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:31.247222 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.40.100,3260]
May 14 04:48:31.247222 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.40.100,3260] successful.
May 14 04:48:31.247222 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:31.248436 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.50.100,3260]
May 14 04:48:31.248436 np0000000747 nova-compute[97971]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.50.100,3260] successful.
May 14 04:48:31.248436 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:31.259013 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:31.264054 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:48:31.271485 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.271485 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.271485 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:48:31.271645 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.271645 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.271645 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:48:31.271888 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:48:31.271997 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Connected to 192.168.40.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:48:31.272508 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:48:31.272620 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:48:31.276691 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.276691 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.276691 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:48:31.276797 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.276797 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:48:31.276797 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:48:31.276998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.121s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:48:31.277192 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Connected to 192.168.50.100:3260 {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 14 04:48:31.277505 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=97971) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 14 04:48:31.277603 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=97971) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 14 04:48:31.287322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:48:31.287322 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:48:31.292952 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: None {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:48:31.609863 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:32.114401 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:32.114578 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:32.114711 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:32.114867 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:48:32.125488 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:48:32.126240 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:32.172250 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:32.172589 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=14220MB free_disk=72.60157012939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:48:32.172774 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:32.172997 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:32.293821 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=97971) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 14 04:48:32.294196 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=97971) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 14 04:48:32.379433 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:33.171163 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Found WWN 3300000006c97bd4e for multipath device dm-0 {{(pid=97971) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 14 04:48:33.171163 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.030s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:48:33.171341 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '3300000006c97bd4e', 'path': '/dev/dm-0', 'multipath_id': '3300000006c97bd4e'} {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:48:33.171477 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006c97bd4e', 'path': '/dev/dm-0', 'multipath_id': '3300000006c97bd4e'} {{(pid=97971) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 14 04:48:33.223777 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Instance d2b5c567-0368-42b9-b7f6-b3714fb73b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=97971) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 14 04:48:33.223966 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:48:33.224096 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:48:32 up 49 min,  2 users,  load average: 1.18, 2.84, 4.10\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_os_type_None': '1', 'num_proj_f28bf0fd9b8a45d78b47fc5f8b0dea82': '1', 'io_workload': '1'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:48:33.304966 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:48:33.305318 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:48:33.676752 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-248276871',display_name='tempest-instance-248276871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-instance-248276871',id=81,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLQuJDBu8cTkAtu4watREswToXGOYY7SfkE1ijJX0Mnc6H+Z10F3qXEX0ImiyQRYv2OPI9EqfooJdEAoEEUC5TWMsV9RH5J4pE6gDAXhm2aT2EHncWVvDg0raVziFPyrA==',key_name='tempest-keypair-754439130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f28bf0fd9b8a45d78b47fc5f8b0dea82',ramdisk_id='',reservation_id='r-oxy30b90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-184829899',owner_user_name='tempest-VolumesBackupsTest-184829899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b0c1ee4f0d24495920acef8029edf57',uuid=d2b5c567-0368-42b9-b7f6-b3714fb73b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=97971) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 14 04:48:33.677002 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converting VIF {"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:48:33.677724 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:48:33.678494 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lazy-loading 'pci_devices' on Instance uuid d2b5c567-0368-42b9-b7f6-b3714fb73b2f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:48:33.807948 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:48:34.182374 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] End _get_guest_xml xml=<domain type="qemu">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <uuid>d2b5c567-0368-42b9-b7f6-b3714fb73b2f</uuid>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <name>instance-00000051</name>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <memory>196608</memory>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <vcpu>1</vcpu>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <metadata>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:package version="33.1.0"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:name>tempest-instance-248276871</nova:name>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:creationTime>2026-05-14 04:48:29</nova:creationTime>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:flavor name="m1.nano" id="42">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:memory>192</nova:memory>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:disk>1</nova:disk>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:swap>0</nova:swap>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:ephemeral>0</nova:ephemeral>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:vcpus>1</nova:vcpus>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:extraSpecs>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         </nova:extraSpecs>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       </nova:flavor>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:image uuid="61ff7b79-8a72-479d-a718-78041e1efa4d">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:containerFormat>bare</nova:containerFormat>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:minDisk>1</nova:minDisk>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:minRam>0</nova:minRam>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:properties>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         </nova:properties>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       </nova:image>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:owner>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:user uuid="6b0c1ee4f0d24495920acef8029edf57">tempest-VolumesBackupsTest-184829899-project-member</nova:user>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:project uuid="f28bf0fd9b8a45d78b47fc5f8b0dea82">tempest-VolumesBackupsTest-184829899</nova:project>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       </nova:owner>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:root type="image" uuid="61ff7b79-8a72-479d-a718-78041e1efa4d"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <nova:ports>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         <nova:port uuid="a6cc9112-90af-4c19-aba2-5cf4313e8cdc">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:         </nova:port>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       </nova:ports>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </nova:instance>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </metadata>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <sysinfo type="smbios">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <system>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="product">OpenStack Nova</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="version">33.1.0</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="serial">d2b5c567-0368-42b9-b7f6-b3714fb73b2f</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="uuid">d2b5c567-0368-42b9-b7f6-b3714fb73b2f</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <entry name="family">Virtual Machine</entry>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </system>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </sysinfo>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <os>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <type arch="x86_64" machine="pc">hvm</type>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <boot dev="hd"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <smbios mode="sysinfo"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </os>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <features>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <acpi/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <tcg>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <tb-cache unit="MiB">128</tb-cache>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </tcg>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <vmcoreinfo/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </features>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <iothreads>1</iothreads>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <clock offset="utc"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <cpu mode="custom" match="exact">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <model>Nehalem</model>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <topology sockets="1" cores="1" threads="1"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </cpu>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   <devices>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <disk type="file" device="disk">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <driver name="qemu" type="qcow2" cache="none"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <target dev="vda" bus="virtio"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </disk>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <disk type="file" device="cdrom">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <source file="/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.config"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <target dev="hda" bus="ide"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </disk>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <disk type="block" device="disk">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <alias name="ua-c4b91e00-4230-487f-bca1-72f79e9910fd"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <source dev="/dev/dm-0"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <target dev="vdb" bus="virtio"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <serial>c4b91e00-4230-487f-bca1-72f79e9910fd</serial>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </disk>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <interface type="ethernet">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <mac address="fa:16:3e:7a:dc:a3"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <driver name="qemu"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <mtu size="1372"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <target dev="tapa6cc9112-90"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </interface>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <serial type="pty">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <log file="/opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/console.log" append="off"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </serial>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <video>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <model type="virtio"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </video>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <rng model="virtio">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <backend model="random">/dev/urandom</backend>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </rng>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <controller type="usb" index="0" model="none"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:       <stats period="10"/>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:     </memballoon>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:   </devices>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]: </domain>
May 14 04:48:34.182374 np0000000747 nova-compute[97971]:  {{(pid=97971) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Preparing to wait for external event network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-14T04:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-248276871',display_name='tempest-instance-248276871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-instance-248276871',id=81,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLQuJDBu8cTkAtu4watREswToXGOYY7SfkE1ijJX0Mnc6H+Z10F3qXEX0ImiyQRYv2OPI9EqfooJdEAoEEUC5TWMsV9RH5J4pE6gDAXhm2aT2EHncWVvDg0raVziFPyrA==',key_name='tempest-keypair-754439130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f28bf0fd9b8a45d78b47fc5f8b0dea82',ramdisk_id='',reservation_id='r-oxy30b90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-184829899',owner_user_name='tempest-VolumesBackupsTest-184829899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-14T04:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b0c1ee4f0d24495920acef8029edf57',uuid=d2b5c567-0368-42b9-b7f6-b3714fb73b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converting VIF {"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90') {{(pid=97971) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:48:34.185793 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 14 04:48:34.186356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.186356 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4792124-7426-5a60-83dd-ae7c76c10815', '_type': 'linux-noop'}}, row=False) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:48:34.187028 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.187621 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:48:34.187753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.189264 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.189377 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6cc9112-90, may_exist=True, interface_attrs={}) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:48:34.189649 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6cc9112-90, col_values=(('qos', UUID('917dbac9-78a6-47b4-9379-de6aa6631b3e')),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:48:34.189813 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6cc9112-90, col_values=(('external_ids', {'iface-id': 'a6cc9112-90af-4c19-aba2-5cf4313e8cdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:dc:a3', 'vm-uuid': 'd2b5c567-0368-42b9-b7f6-b3714fb73b2f'}),), if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:48:34.190832 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.191839 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:48:34.196449 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:34.197672 np0000000747 nova-compute[97971]: INFO os_vif [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90')
May 14 04:48:34.313567 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:48:34.314106 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.141s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:34.314106 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:35.314077 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:35.314477 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:35.314788 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.29 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:35.593634 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:35.609783 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:35.610090 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:35.711813 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] No BDM found with device name vda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:48:35.711961 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:48:35.712112 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] No BDM found with device name hda, not building metadata. {{(pid=97971) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 14 04:48:35.712240 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] No VIF found with MAC fa:16:3e:7a:dc:a3, not building metadata {{(pid=97971) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 14 04:48:35.712687 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Using config drive
May 14 04:48:36.217535 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:36.314628 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Creating config drive at /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.config
May 14 04:48:36.318164 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppoc2l83a {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:48:36.374223 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppoc2l83a" returned: 0 in 0.056s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:48:36.728727 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:36.745013 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:36.746434 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:36.855153 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:36.861383 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:36.868978 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fa9b0806-2e6f-4bb2-b2d1-817cf060dc2a req-2b7043be-e8fc-4c44-bc0c-71135ff9ed29 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:48:36.869352 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fa9b0806-2e6f-4bb2-b2d1-817cf060dc2a req-2b7043be-e8fc-4c44-bc0c-71135ff9ed29 service nova] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:36.869730 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fa9b0806-2e6f-4bb2-b2d1-817cf060dc2a req-2b7043be-e8fc-4c44-bc0c-71135ff9ed29 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:36.870005 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-fa9b0806-2e6f-4bb2-b2d1-817cf060dc2a req-2b7043be-e8fc-4c44-bc0c-71135ff9ed29 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:36.870199 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-fa9b0806-2e6f-4bb2-b2d1-817cf060dc2a req-2b7043be-e8fc-4c44-bc0c-71135ff9ed29 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Processing event network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 14 04:48:37.121664 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:37.123239 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:37.125133 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:37.126210 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:37.141952 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:37.452162 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=97971) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 14 04:48:37.452697 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778734117.4522774, d2b5c567-0368-42b9-b7f6-b3714fb73b2f => Started> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:48:37.452894 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] VM Started (Lifecycle Event)
May 14 04:48:37.454520 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Guest created on hypervisor {{(pid=97971) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 14 04:48:37.456986 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance spawned successfully.
May 14 04:48:37.457268 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 14 04:48:37.609933 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:37.610080 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:48:37.610340 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:37.956230 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:48:37.958480 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:48:37.965097 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_cdrom_bus of ide {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:37.965223 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_disk_bus of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:37.965602 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_input_bus of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:37.966003 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_pointer_model of None {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:37.966358 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_video_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:37.966737 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Found default for hw_vif_model of virtio {{(pid=97971) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 14 04:48:38.462935 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] During sync_power_state the instance has a pending task (spawning). Skip.
May 14 04:48:38.463405 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778734118.462982, d2b5c567-0368-42b9-b7f6-b3714fb73b2f => Paused> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:48:38.463405 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] VM Paused (Lifecycle Event)
May 14 04:48:38.472588 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Took 9.78 seconds to spawn the instance on the hypervisor.
May 14 04:48:38.472758 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] No waiting events found dispatching network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:48:38.927201 np0000000747 nova-compute[97971]: WARNING nova.compute.manager [req-2d78d6c2-5056-4198-bfcd-1dcb56c3cd7a req-7dfd1085-3e4f-42f0-9310-a6bcbd94f240 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received unexpected event network-vif-plugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc for instance with vm_state active and task_state None.
May 14 04:48:38.965468 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:48:38.967462 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Emitting event <LifecycleEvent: 1778734118.9672759, d2b5c567-0368-42b9-b7f6-b3714fb73b2f => Resumed> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:48:38.967569 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] VM Resumed (Lifecycle Event)
May 14 04:48:38.983581 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Took 17.38 seconds to build instance.
May 14 04:48:39.190675 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:39.469858 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:48:39.472028 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=97971) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 14 04:48:39.485177 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.887s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:48:40.990428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-changed-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:48:40.990428 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Refreshing instance network info cache due to event network-changed-a6cc9112-90af-4c19-aba2-5cf4313e8cdc. {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 14 04:48:40.990428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] Acquiring lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 14 04:48:40.990428 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] Acquired lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 14 04:48:40.990428 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Refreshing network info cache for port a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 14 04:48:41.491631 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:41.602031 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:41.610137 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:48:41.610369 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:48:41.743286 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:48:41.849874 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updated VIF entry in instance network info cache for port a6cc9112-90af-4c19-aba2-5cf4313e8cdc. {{(pid=97971) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 14 04:48:41.850154 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating instance_info_cache with network_info: [{"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:48:42.352034 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-857bf2cc-6519-49ca-839b-30038c2816e0 req-0accd533-6b53-4bfe-8148-60db283f418f service nova] Releasing lock "refresh_cache-d2b5c567-0368-42b9-b7f6-b3714fb73b2f" {{(pid=97971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 14 04:48:44.191926 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:46.601694 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:49.193038 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:51.602326 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:54.194180 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:56.603647 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:48:59.195163 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:01.605490 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:04.195428 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:06.607167 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:09.197018 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:11.609385 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:14.198082 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:16.611550 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:16.937263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:16.937263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:16.937263 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:16.937494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:16.937494 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:16.939681 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Terminating instance
May 14 04:49:17.442514 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Start destroying the instance on the hypervisor. {{(pid=97971) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 14 04:49:17.458088 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.476934 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.479817 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.492383 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.501893 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.591057 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:49:17.591514 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:17.591700 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:17.591821 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:17.592080 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] No waiting events found dispatching network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:49:17.592080 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-991f5d9f-d9b1-479b-961e-2afaff537c6d req-802ad2a6-dea7-4610-a2bf-d3a73d9e22b7 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:49:17.734396 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.743114 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:17.766511 np0000000747 nova-compute[97971]: DEBUG nova.utils [None req-5cfbe17b-5b26-4e81-8c66-6a9249a6a4b7 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.999686653000026 future=<Future at 0x74361bfad790 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:49:17.767536 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998636908999742 future=<Future at 0x74361bfad790 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:49:17.767666 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=14.998523717999888 future=<Future at 0x74361bfad790 state=pending>) {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:49:17.768812 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Instance destroyed successfully.
May 14 04:49:17.769409 np0000000747 nova-compute[97971]: DEBUG nova.objects.instance [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lazy-loading 'resources' on Instance uuid d2b5c567-0368-42b9-b7f6-b3714fb73b2f {{(pid=97971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 14 04:49:18.271562 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.vif [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-14T04:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-248276871',display_name='tempest-instance-248276871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000747',hostname='tempest-instance-248276871',id=81,image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLQuJDBu8cTkAtu4watREswToXGOYY7SfkE1ijJX0Mnc6H+Z10F3qXEX0ImiyQRYv2OPI9EqfooJdEAoEEUC5TWMsV9RH5J4pE6gDAXhm2aT2EHncWVvDg0raVziFPyrA==',key_name='tempest-keypair-754439130',keypairs=<?>,launch_index=0,launched_at=2026-05-14T04:48:38Z,launched_on='np0000000747',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000747',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f28bf0fd9b8a45d78b47fc5f8b0dea82',ramdisk_id='',reservation_id='r-oxy30b90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61ff7b79-8a72-479d-a718-78041e1efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-184829899',owner_user_name='tempest-VolumesBackupsTest-184829899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-14T04:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b0c1ee4f0d24495920acef8029edf57',uuid=d2b5c567-0368-42b9-b7f6-b3714fb73b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 14 04:49:18.271817 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converting VIF {"id": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "address": "fa:16:3e:7a:dc:a3", "network": {"id": "2d4912aa-c08c-4c41-a381-2193d9627567", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1778349108-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f28bf0fd9b8a45d78b47fc5f8b0dea82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6cc9112-90", "ovs_interfaceid": "a6cc9112-90af-4c19-aba2-5cf4313e8cdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 14 04:49:18.272295 np0000000747 nova-compute[97971]: DEBUG nova.network.os_vif_util [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90') {{(pid=97971) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 14 04:49:18.272503 np0000000747 nova-compute[97971]: DEBUG os_vif [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90') {{(pid=97971) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 14 04:49:18.273801 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:18.274035 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6cc9112-90, bridge=br-int, if_exists=True) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:49:18.275061 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:18.275927 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:49:18.276536 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:18.276684 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=917dbac9-78a6-47b4-9379-de6aa6631b3e) {{(pid=97971) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 14 04:49:18.277298 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:18.277556 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:49:18.279134 np0000000747 nova-compute[97971]: INFO os_vif [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:dc:a3,bridge_name='br-int',has_traffic_filtering=True,id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc,network=Network(2d4912aa-c08c-4c41-a381-2193d9627567),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6cc9112-90')
May 14 04:49:18.280529 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] calling os-brick to detach iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 14 04:49:18.280852 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7436185c3770>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 14 04:49:18.280980 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 14 04:49:18.281365 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 14 04:49:18.281671 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c4b91e00-4230-487f-bca1-72f79e9910fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 14 04:49:18.281811 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', 0)] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 14 04:49:18.302782 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:49:18.302782 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:49:18.302782 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 14 04:49:18.302998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:49:18.302998 np0000000747 nova-compute[97971]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd (non-flash)
May 14 04:49:18.302998 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 14 04:49:18.302998 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', '226')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 14 04:49:18.303201 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', '225')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:49:18.303844 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd', '226')] {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 14 04:49:18.304395 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7435f84974c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'): ({'sdc'}, set())}) {{(pid=97971) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 14 04:49:18.304570 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Removing multipathed devices sdc, sdb {{(pid=97971) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 14 04:49:18.304799 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Flush multipath device 3300000006c97bd4e {{(pid=97971) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 14 04:49:18.357804 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:49:18.410097 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=97971) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 14 04:49:18.465194 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 14 04:49:18.465366 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=97971) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 14 04:49:18.466030 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 14 04:49:18.477303 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.linuxscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=97971) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 14 04:49:18.477563 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd')] {{(pid=97971) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 14 04:49:18.487533 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.514824 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.40.100,3260]
May 14 04:49:18.514824 np0000000747 nova-compute[97971]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.40.100,3260] successful.
May 14 04:49:18.514824 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.526722 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.536999 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.563703 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.50.100,3260]
May 14 04:49:18.563703 np0000000747 nova-compute[97971]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-c4b91e00-4230-487f-bca1-72f79e9910fd, portal: 192.168.50.100,3260] successful.
May 14 04:49:18.563703 np0000000747 nova-compute[97971]:  stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.574373 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=97971) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 14 04:49:18.574626 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.base [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 14 04:49:18.574755 np0000000747 nova-compute[97971]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] <== disconnect_volume: return (294ms) None {{(pid=97971) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 14 04:49:18.574897 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Disconnected iSCSI Volume {{(pid=97971) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 14 04:49:18.575166 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Deleting instance files /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f_del
May 14 04:49:18.575877 np0000000747 nova-compute[97971]: INFO nova.virt.libvirt.driver [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Deletion of /opt/stack/data/nova/instances/d2b5c567-0368-42b9-b7f6-b3714fb73b2f_del complete
May 14 04:49:19.081578 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Took 1.64 seconds to destroy the instance on the hypervisor.
May 14 04:49:19.082197 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._common.loopingcall [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=97971) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 14 04:49:19.082538 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Deallocating network for instance {{(pid=97971) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 14 04:49:19.082739 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] deallocate_for_instance() {{(pid=97971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 14 04:49:19.083031 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:49:19.174166 np0000000747 nova-compute[97971]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 14 04:49:19.569728 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:19.643821 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:49:19.643966 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] Acquiring lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:19.644141 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:19.644304 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:19.645271 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] No waiting events found dispatching network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 14 04:49:19.645479 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-unplugged-a6cc9112-90af-4c19-aba2-5cf4313e8cdc for instance with task_state deleting. {{(pid=97971) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 14 04:49:19.645636 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Received event network-vif-deleted-a6cc9112-90af-4c19-aba2-5cf4313e8cdc {{(pid=97971) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 14 04:49:19.645798 np0000000747 nova-compute[97971]: INFO nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Neutron deleted interface a6cc9112-90af-4c19-aba2-5cf4313e8cdc; detaching it from the instance and deleting it from the info cache
May 14 04:49:19.645968 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:49:20.096448 np0000000747 nova-compute[97971]: DEBUG nova.network.neutron [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Updating instance_info_cache with network_info: [] {{(pid=97971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 14 04:49:20.149204 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [req-48f7b273-e0b4-48a0-9107-fcaecef959f7 req-d346cd3a-ba85-4a50-aa2d-971cdb24ded2 service nova] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Detach interface failed, port_id=a6cc9112-90af-4c19-aba2-5cf4313e8cdc, reason: Instance d2b5c567-0368-42b9-b7f6-b3714fb73b2f could not be found. {{(pid=97971) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 14 04:49:20.598341 np0000000747 nova-compute[97971]: INFO nova.compute.manager [-] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Took 1.52 seconds to deallocate network for instance.
May 14 04:49:21.142503 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Took 0.54 seconds to detach 1 volumes for instance.
May 14 04:49:21.611459 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:21.648041 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:21.648227 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:21.744027 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:49:21.745037 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:49:22.246762 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:49:22.753023 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.105s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:22.798350 np0000000747 nova-compute[97971]: INFO nova.scheduler.client.report [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Deleted allocations for instance d2b5c567-0368-42b9-b7f6-b3714fb73b2f
May 14 04:49:23.278646 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:23.807193 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-f58c1b24-c406-42d4-89dc-44ccd6adbb64 tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Lock "d2b5c567-0368-42b9-b7f6-b3714fb73b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.870s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:26.601318 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:26.601676 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:28.281431 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:29.609750 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:29.610183 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:32.609837 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:32.610290 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:32.766549 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x743636c26b10>>, remaining_delay=-0.0003262160003032477 future=<Future at 0x74361bfad790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x743636b8d730> {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:49:32.767066 np0000000747 nova-compute[97971]: DEBUG nova.virt.driver [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] Emitting event <LifecycleEvent: 1778734157.7661002, d2b5c567-0368-42b9-b7f6-b3714fb73b2f => Stopped> {{(pid=97971) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 14 04:49:32.767219 np0000000747 nova-compute[97971]: DEBUG nova.utils [-] Waiting for the next task {{(pid=97971) _log /opt/stack/nova/nova/utils.py:1500}}
May 14 04:49:32.767409 np0000000747 nova-compute[97971]: INFO nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] VM Stopped (Lifecycle Event)
May 14 04:49:33.270002 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-982951b4-75c6-4e31-ac24-faf0b52714ed tempest-VolumesBackupsTest-184829899 tempest-VolumesBackupsTest-184829899-project-member] [instance: d2b5c567-0368-42b9-b7f6-b3714fb73b2f] Checking state {{(pid=97971) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 14 04:49:33.284122 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:33.609853 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:33.610274 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:34.113914 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:34.114019 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:34.114099 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:34.114230 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:49:34.127035 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:49:34.127803 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:49:34.173283 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:49:34.173675 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=14238MB free_disk=72.59800338745117GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:49:34.173865 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:49:34.174057 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:49:35.225299 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:49:35.225731 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:49:34 up 50 min,  2 users,  load average: 0.86, 2.45, 3.88\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:49:35.268863 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:49:35.269090 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:49:35.771605 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:49:36.277477 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:49:36.277876 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:49:36.278064 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:38.277782 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:38.278238 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:38.278238 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:49:38.278339 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.33 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:38.285753 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:43.287566 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:43.610372 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:49:43.610688 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:49:48.289243 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:53.290421 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:49:58.292903 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:03.294177 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:03.433465 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:03.665279 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:08.295650 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:13.297361 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:18.297982 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:50:18.298525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:50:18.298525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:50:18.298525 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:50:18.298843 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:18.298994 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:50:23.317907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:50:23.317907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 14 04:50:23.317907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=97971) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 14 04:50:23.317907 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:50:23.318388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:23.318388 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=97971) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 14 04:50:26.601568 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:26.602290 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:28.319730 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:31.609880 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:31.610342 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:33.321768 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:33.601810 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:33.602116 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.01 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:34.609803 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:34.610427 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:34.610708 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:35.596170 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:35.609956 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:36.114634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:50:36.114634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:50:36.114634 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:50:36.114634 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Auditing locally available compute resources for np0000000747 (node: np0000000747) {{(pid=97971) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 14 04:50:36.126179 np0000000747 nova-compute[97971]: WARNING nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 14 04:50:36.127281 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 14 04:50:36.174016 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.processutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=97971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 14 04:50:36.174364 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Hypervisor/Node resource view: name=np0000000747 free_ram=14526MB free_disk=72.58834457397461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=97971) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 14 04:50:36.174520 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 14 04:50:36.174839 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 14 04:50:37.220609 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 14 04:50:37.220959 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Final resource view: name=np0000000747 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:50:36 up 51 min,  1 user,  load average: 0.70, 2.13, 3.68\n'} {{(pid=97971) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 14 04:50:37.263430 np0000000747 nova-compute[97971]: DEBUG nova.virt.libvirt.driver [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=97971) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 14 04:50:37.263653 np0000000747 nova-compute[97971]: DEBUG nova.compute.provider_tree [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed in ProviderTree for provider: 31f323e6-64de-412b-a8c9-20c9194ab897 {{(pid=97971) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 14 04:50:37.766376 np0000000747 nova-compute[97971]: DEBUG nova.scheduler.client.report [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Inventory has not changed for provider 31f323e6-64de-412b-a8c9-20c9194ab897 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=97971) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 14 04:50:38.272600 np0000000747 nova-compute[97971]: DEBUG nova.compute.resource_tracker [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Compute_service record updated for np0000000747:np0000000747 {{(pid=97971) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 14 04:50:38.273075 np0000000747 nova-compute[97971]: DEBUG oslo_concurrency.lockutils [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=97971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 14 04:50:38.273075 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:38.323882 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:39.273166 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:39.273784 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:39.273784 np0000000747 nova-compute[97971]: DEBUG nova.compute.manager [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=97971) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 14 04:50:39.273784 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.34 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:43.326061 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:43.610431 np0000000747 nova-compute[97971]: DEBUG oslo_service.periodic_task [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=97971) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 14 04:50:43.610627 np0000000747 nova-compute[97971]: DEBUG oslo.service.backend._threading.loopingcall [None req-320670f8-a8ec-4317-9d5f-065c709e72a1 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.99 seconds {{(pid=97971) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 14 04:50:48.328059 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:53.329284 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:50:58.330919 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:51:03.332956 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:51:08.334869 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:51:13.336845 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:51:18.338829 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 14 04:51:23.340115 np0000000747 nova-compute[97971]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=97971) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}